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cane The papers printed here ware commissi toned by the Suneau of Education for’ ‘the 
™ Handicapped to investigate issues of quality in the implementation: of the Due 
Process” Procedural . Safeguards provisions of P:L, 94-142 (Section: 615. ‘of the 
Education: of the Handicapped Act), A panet of: educational practitioners was 
cs also convened: to discuss the papiers and provide recommendations to. the: Bureau. 
: Their. comments, together with the papers, represent the most recent thinking 
* and activities of a “number of highly quali fide! pro fessionais While the views. 
expressed in, the papers are “thase: principaily of the authors, each wrrter has . 
oN drawn upon the experiences, writings, "research, and observations of various. 
a other educators: in’ addition t6 their ‘own. The. care with which both ‘the author 
and, the panel sts shared their thoughts sri ideas i$ obvidus throughout this: 
ae c ge li is our hope that i rie tae nat only be informative, but 
that, will stimulate other thoughts on the evaluation of effectiveness of 
.. implementation, ‘ a , 
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co ‘of. the. major - purposes of Public Law. 94. 142, the. Education for: All 

“Handicapped Children Act of 1975,° are to assure shat all handicapped: children : 

_ have. available to them.a free, appropriate public education: and to assure ‘that ‘the ar 
- rights. of handicapped children: and their-parents or. guardians are protected: an 2 S 
the ‘educational Process, evaluation: of the child is necessary. in ordet: both.to | 
‘determine eligibility: for special education and rejated services, and. to’ design. an” * : 
. individualized educational prograin which meets. the handicapped child's: unique : 
“needs. Without the. evaluation process, the adequacy and appropriateness of the" 
~ child! S: educational program. would be questionable. In developing the Act, ‘the 
Congress: recognized the importance - of. ‘child’ evaluation,. but ‘also- delineated 
‘three major areas of concern related to: the identification and ‘classification of: | 
_ handicapped children (Senate_ Report No. 94-168, ‘Education for “All: Handi- 
capped Children Act, June 2, 4975, pp. 26- 29). These concerns were (1) the --- 
~ misuse ‘of appropriate identification and classification data within the dducation-. - 

- ’. al process itself, (2) discriminatory treatment as the result of the identification | 
<> of a handicapping -condition, and (3) misuse of identification Procedures: or. 
- methods so that the ¢hild. is ‘erroneously classified as having a handicapping. 

condition, = _ 3 


__ In. response: to these concerns, the Congress wrote into P:L. 94-142 (Section ere: 
615): procedural safeguards to be. provided to parents in decisions regarding the 
identification, evaluation, and educational placement of handicapped children, 
aS well-as, specific conditions which test and evaluation procedures and materials 
até to meet (Section 612(5}(C)). In addition, the Commissioner of Education — 
“was directed to issue regulations which assure that state and local educational , 
“agencies establish procedures to. insure that these conditions are met with regard - 
tq testing: and evaluation. The Commissioner was also directed to report to” 
Congress concerning the procedures implemented by the states’ to Prevent. 
erroneous classification of children. “As a result of the mandates, the Bureau, of — 
Education - ‘the Handicapped (BEH) developed and published ‘regulations 
“<concerning protection in evaluation procedures (45 CFR Part 121a.530 -.534). 
The regulations are the basis of .a Program ‘Administrative Review (PAR) ~. 
‘procedure which has been cdevetoped by BEH for gonitoring implementatian of . 
-P.L..94-142, including-the child testing and valtibontrecamn 
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“THE REGULATIONS 3 


“The ragolaeiokt to P.L. 94-142 provide a framework for imptementation of the — 
protection in evaluation procedures’ (PEP) provisians, but leave many details to 
state. and/or local educational agency discretion. Section 121a.530 of the. 
regulations, for example, requires that state and local educational agencies insure 
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*PL, 94-142 amends Part B of the Education of the Handicapped Act, which, author: 
. izes a forrnulayrant program to assist states in providing tree appropriate public education to. _ 
_ handicapped children. : - ‘, . es 


& that. testing She “evaluation materiats. and procuderes ied: far the purposes ee 
>-evaluation. and placement of handigapped children are selected and administered - 
- $0. a NOt. to. be racially. or culturally discriminatory. As .is evidenced. in the 
current. case. of “Larry: P.. MS. Riles, ‘however; there is considerable controversy. 
concerning which. tests meet ‘the non-discriminatory.. criterion. In this case, the 
issue. is whether: ‘California schools may use IQ tests in: decisions regarding the. 
© identification, classification, and. educational placement of. handicapped chil 
dren. Plaintiffs argue. that such tests are racially and culturally biased, while the 


oe 


" efense argues. that these tests are neutral. oe et 


Section 121a 531 of he: feguiations requires satis a full and: ‘adividuak evaluation 
of a child’s educational: needs be conductetd prior tothe initial placement of a 
© handicapped: child in a special education program. Re-evaluation, of the child is. 
sto. be conducted every three years or more frequently if ‘indicated .. Iti is Section 
V21a. 532 which delineates specific§ evaluation procedures _which must. be 
~ conducted. These. procedures inctude the: requirements that tests and ‘evaluation 
materials: (1) are provided and administered in-the child’s native language or 
“other mode “of ‘communication, unless it is clearly not feasible. to do-so; (2) have’ 
been validated for the specific purpose for. which they- are. used, (3). are. 
~ administered » “by” trained personnel. in conformance. with. the. instructions. . 
“provided ‘by their producer: (4) include those tailored to assess specific areas of 
educational need and - not merely those which are designed to provide a single ; 
‘general -intelliggnce quotient: and (5) are selected and administered so that the << oe - 
results accurately reflect the-factors that test purports ‘to measure, rather than 
7 reflecting the child's impaired sensory, manual, or speaking skills (except where : 
“those skills are the factors which the test purports to measure): In addition, no ~ - a 
“sifigle procedure is'to be used as the sole criterion for determining. a child’s 
education program, and. the child is to be assessed ih all areas. related! to the ° 
suspected disability. This section of the regulations also specifies that the 

~ evaluation’: is to be made by a multi-disciplinary team or group of persons, 
inctuding at least one teacher ‘or other specialist with knowledge in the area of 
the. suspected disability. Finally, section 121a.533 of the ‘regulations specifies 
“procedures to be followed in interpreting evaluation core and making placement 
“decisions. i. ~. ° =F é 2° 


<y 


———“As~stated;~the- every-day translation “oF the’ <fegulations “inte” “practice is the 
- “province, of state and local educational: agencies. At these levels, however, there ass 
are many questions to be resolved. How does one define and implement the 
feasibility reference concerning testing ina child's native language? What test - 

~ administration: procedures: ‘should’, be established to insure that the procedures oe 

: are non-discriminatory? How should -the concept of validation be.defined and - 
operationalized? The overriding. ‘question can. be viewed, at the school district - 
- level, what ‘would exemplary implementation of the: ‘protection; in evaluation. 
procedures (PEP) provisions look like? The Bureau of Education tor the ; 
 vangteapene is interested in ese states oy Supporting the development and | i - . 
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‘dissemination at éxemplary’ “implementation procedures. State education: agen. 
“cies (SEAS), responsible under P.L. 94. 142 for monitoring tocal implementation : 
sof ‘the ‘PEP provisions and providing technical assistance; must take the. lead in. . 
: developing: State standards for PEP implementation.: Finally, local ‘education .: 
agencies (LEAs). must conduct their. own internal evaluations of PEP implemen- 
tation, The following. section describes.an approach | undertaken’ to i hdl 
hi the issue of f quality or. exemplary procedures. on. . 


THE APPROACH’ 


te is evident that: for queitions concerning a.quslicy te a qadiesed: criteria are 
“needed which can be used to evaluate. implementation. To stimulate ‘thought 
regarding definitions of quality, the BEH undertook a. study in October, 1977 to, - 
‘explore. issues of quality. in implementation of Tour: ‘major ‘provisions of P. Le 
94-142. this ‘monograph ° ‘summarizes activities related to one of those provisions 
= : Protection - in evaluation procedures. The study had two major Parts, First, 
four Papers” were cotnmissioned to *brovide professional” judgements, of quality 
implementation of the PEP Provisions. Second,-a. panel. of education. practition= ~ 
ers.. was. convened to discuss . the papers and. make recommendations: to. ‘BEH 
concerning their. Lctade and use. fs. te SOO ; . 


Le 


ay conceptualizing the sutdy, it was recognized that evaluation never takes place 
ina vacuum; standards ‘are always involved, Judgements of the perforrnance of a 
‘ program or procedures are measured: against either explicit or implicit standards. 
Standards are derived from experience, Knowledge, and/or values. The difficulty - 
is that standards will vary according to whose experience, knowledge, and values = |, ts 
serve as the basis: for the standards. For. example, ‘the regulations state that tests 
and other evaluation materiats must be selected so as not to be racially, or 
‘ _ culturally discriminatory. Criteria for the evaluation of PEP implementation 
would be likely: to va -however, depending on one's interpretation of this: 
concept. Educators and o psychologists have long been concerned. with test: bias - 
.. and have developed different approaches .to the issue. One: sugh. effort, for 
. example, has. been the development of culture-tair tests. Such tests attempt to poe 
represent multiple cultures, rather than. any one. particular dominant: cultural * % e 4 


“group: “Wpile” ‘culture-fairtests have not been good” predictors “of School success, | 
an advocate might establish the ériterion | that they be-used as"a supplement to - 
- traditional 10 tests in the evaluation of children fromm minority groups. “Another” 
" appioach, the fair use of-tests, is based:on the premise that tests are fair; it is. 
* .theituse which is ‘problematic ‘and may result in racial or cultural: ‘discrimination: ae 
An. advocate of this positior might establish the criterion, for example, that a: 
_minority group child be evaluated only: by. an ‘examiner who is a meme? of ne 

- same peony. aeue as the child, 


. s ‘i - 2 hi i cae 
Because a variety of standards ‘are possible, authors were selected-for this study. 
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Authors’ \ were ‘sprevided: ‘guidelines’ amiae first, expanded on the subject of. 

qualitative: implementation of -the. “PEP provisians. Progress | in implementation ™ 

was conceptualized as a continuum: conformance with the letter of the law was *. 

‘viewed as one end, of. the ‘cOntinuuin: (minimal. implementation), while a full. : 

7 “aneeting of the intent or Spirit. cof the law would forthe. other.(maximal} end ‘of ot 
oo the: ‘continuum, Authors were. to. use we concept of progress | in implementation” 

‘in developing their papers. ‘ : 


eis os » 


‘Secondiy:> ‘the: guiidetines requested, that authors daveieg, criteria ‘that would ies 
applicable ‘at the: LEA. tevel or to any’ “public: agency” directly responsible for 
r ducating handicapped children. Thus, the developed | criteria could” ‘be used: by 
LEAS: ‘interested ‘in evaluating their ‘own progress in implementation of the PEP 
‘provisions, ‘as” well as, by SEAs in ‘conducting - their own, evaluations, The 
guidelines further. indicated that criteria which would involve. the- collection ‘of 
data, ‘either already available or relatively accessible to LEAS at ‘a low. cost of: 
‘both time and money would. be most useful, 
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Third, ‘authors were requested to tiedelop’ criteria for, determining: a) the quality: . 
- of procedures: -undertaken by & to implernent the protection in ‘evaluation : 
procedures provisions of ‘the: few. can {2) the effectiveness of the. protection in 
evaluation procedures implemented ‘by LEAs. Thus, authors of PEP position _ : 
papers. were to develop Criteria. which could be used by ‘LEAs as approximate ‘ao - 
_ indicators ‘of the extent to which PEP procedures impiemented by. LEAs eet - 
‘both the a and intent or spirit of “ law, and the extent to which they are Me : 
erttectines ae he moet oe oe eee 
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pS Paint, _authors. were. _asked.ta. provide a. anand: Ol. Ljueticanonc for. -their..... 
criteria. It was expected that P.L. 94-142 and..its regulations would provide-a_ 
_ base for the development of critéria. For those criteria used as indicators ‘of 
maximal implernentation, authors. were expected to draw from: ‘theory, research 
: - findings, the. Congressional Record, ‘personal experience, or. personal knowledge — 
of ‘current practices. Where criteria did exceed the requirements of the law and 
regulations, authors were to indicate Wat the criteria represented Gesleule but 
“| not | mandatory Standards. a) es : 


; ritth, the guidelines ackriowlediged the interrelationship of the PEP provisions of.- 
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ee 


requested. that authors. of PEP. ‘position papers consider 7 
, “influences” ‘on: LEA. mplementation ‘of the. bo 
Variables, for consideration. included, tor example, the urban, rural, ‘or 
suburban nature of ‘the « LEA. and. the Nength of. time. the: LEA had: ‘been 
mplementing. SEA: policies similar to P.L. 94- “142. “Authors were to" determine.” 
“whether” a general set of. criteria for. determining progress in ‘implementation of. 
EP. Provisions, could be used . in: varied contexts, “Or. alternately,” whether f° 


‘Ins the initial foruiation: of the study, some: e thought was” -given: ‘to. tater’ 
development: of self- “study guides which could be ‘provided asa form of techni 
‘assistance © to, SEAS: and /or. ‘those ‘LEAs. who wanted to evaluate progress,'| oo , 
‘implementation. ‘Over ° time, the position. ‘papers were” conceptualized. assan \ 
< “exploratory. investigation concerning» the: feasibility.. -of producing selfstudy : 
ides: on “evaluation: of implementation r. ‘thegEP: provisions. The papers were oN 
‘not tobe the prototype self-study guides. From their efforts to develop’criteria, 
however, determination of the featibitity of the task might be made. a a 
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= “ zi . iy “THE PEP CRITERIA STUDY PANEL 


The’ ‘second. part of the. study involved: bringing ee a group largely of” 
: - education: practitioners: to discuss’ thes Position papers and provide recommenda- 
"tions to. BEH. More specifically, the. purpose of the panel: was, stated as follows: - 

°To determine the feasibility “of developing: self-study guides which: ‘could: beused 9. 

“by. state sand/or Jocat education: cagencies to ‘evaluate implementation of the ee 

. protection in evaluation ‘procedures provision of e. L: 94- 142. Feasibility was - 

* defined” to include . topics ‘such as -field- testing: ‘and dissemination, . aS well as os 

= content and format of posible auides. e «ue 368  & a oe 

3 “ge ee i a eS - : : ~ , _ iv, if 

ce The. sane. ‘meeting was. structured” into _ahree_ distinct. _parts: First, authors a 

presented summaries of: their papers and responded, to‘questions. Second, a large: . 

we y arour discussion was s held: ‘concerning issues related to the study. Finally, thr 


~ meeting, These ‘questions were “intended - to stimulate “discussion and the» 7 
"formulation of additional questions by Panelists. : ae 
-cuestion Moe the inv group session: ‘concentrated: on- the 5 eieepins ane of = 
the study: as presented in the guidelines for authors and also as: presented by ths. 


* 


. ee, . 3 


specific: ‘recommendations to’ BEH ¢ ‘on ‘the: possible development, field-testing, . 


and: dissemination of: self-study guides. Specific questions. posed. foe: these groups = 


involved the developers of ‘the-quides, comprehensivenéss. of developed: guides as. 


well’ as: field- -testing-and dissemination: efforts, the. format of. self-study ‘guides 


and: tield-testing. activities, and: ‘the “Utiltiy. ‘of fidld-testing developed. self-study” . 


guides. Questioris were asked additionally eich, Fequested ateaes for,” ‘ 


inereasing wey of the guides to LEAs: 


The number of parielists was ‘intentionally designed to. be small. cit was felt that ‘a 
small group “would: ‘ehcourage an informal atmosphere. and” lively: exchange of : 
ideas. ‘In. selecting: education’ ‘practitioners for: the., pant, ‘emphasis was. Placed: 
; “on representation feom state and: local education agencies. ‘ SOT 


: . ot 
The next. part. of: this monograph. presents the re position papers. As ig ‘soon . 
evident. upon’ reading. the papers, the. authors. varied.in their. interpretations: of 

“the. task and their implementing definitions of non-discriminatory assessment. ‘. 
.. The. ‘papers have Not. been reviewed to. ensure that Federal Statutory” ‘and. 


--tegulatory.: ‘requirernents are accuratily stated. Readers" seeking. to fully under- a 
. stand the Federal requirements are encouraged to read the: regulations for Part’ 8. 


“of. the: Education: of ‘the Handicapped: Act: (45CFR-Part 12ta.; published at 


42FR42473; August 23, 1977; and supplemental procedures for evaluating. 


_Apacitie learning disabilities at 42 FR65082; ‘Decernber 29, aes 


| SECTION 
Protection Evalyation Procedurgs: 


Criteria and Recommendations." 


> Reginald L,Jones. 


ogame ‘of Calitarnia, ‘Berkeley. During 1976: 7 he was: coordinator of the. F 
‘Doctoral “Peogram i in Special Education. onthe Berkeley ‘ ‘Campus. ‘He received: his... 
Ph. ‘D.. in. . Poyetiotoay (with a ‘minor in ‘special education). ‘The aoe ‘State 


EA ata of California, a , 


psycholoay.. ‘The. Ohio ‘State University. and Aaculty: 
ami, “Fisk and Indiana Universities, the last cited. ina 
itten extensively: in the: area of P. L. 94. 142 relating to; 
Z ‘the: evaluation of mainstreaming programs, mainstreaming and the minority child: 


! and 1 mainstreaming 2 and the mildly retarded. Forthcoming’ is “another publication’ oy 


“Special. Education: and: the Future: sgme » questions to be. answered and 
answers tO; be. questioned,” : . hg ‘ 


‘The. plan’ at activity is to move” from’ the.general to the specific, that is, from an. 7 
verview of the, entire identification-assessment-placement, process” tg. an LaLa . 


of error occur "among: ieneak. ‘and coraponents: and it is ‘at ese levale ea! 
rotections: will need: to be developed. The present paper, then,. develops criteria. 


for: ‘insuring: protectians” “at. anaior points in the identification. -assessment-place- . 
. : c= ; 


vo Fifteen raoane of the identification-assessment-placement process (Abeson ets 
wal. * 1975; Brinegar, 1976; Carroll, et al., 1927: ‘Harrison, 1976; National 
ae Association ‘Of State Directors of Special Education. 1976a, 1976b; Office of the. 
Santa. Clara’ County. Superintendent of Schools, no date; Sabatino, 1976; and 
‘Tucker, 1976): were reviewed" ‘(see Appendix): A synthesis of ‘the models/dia- vb 
‘grams/flow charts, would’ suggest a process somewhat as follows: First, a school © 
‘relawd ‘problem. is identified. The problem may be one of: behavior, of 
me achievement: of appropriateness of .the administrative , arrangement, or some .. 
combination of the above. Second, itformal observations and or’ ‘assessment are — 
y deemed necessary,” permission ‘to engage in such activities is sought from 
; _ Parentsiparent surrogates, Third, format observations and assessments by various” 
Specialists {e.9,, school psychologists, school social workers, resource consul... 
: “tants, speech therapists, physicians, and others) are obtained. Fourth, planning 
{ team is constituted to integrate information. received about achild and to make 
‘recommendations for further case disposition: Fifth, an mstructional plan may - 
be formulated. Sixth, follow: ‘up is. required. Obviousty, not alt identification ia 
assessment: placement activities follow the above model in the order. presented, 
“but. mast include the components indicated, or similar ones. 


- In the light of “the above: synthesis, and of -94- 142 stipulations related to — 
‘evaluation | procedures, it would seem seem that major features of the identification-.. 

~ assessment: placement ‘process around which: ‘protections need to be built include 

(y LEA. Provisions for, testing/assessment, (2) communications with parents, a) 
- dimensions of assessment, (4) the planning and placement team, (5) adequate a 


test use, ad. (6) follone-up. 


. 


Drawing omn the research literature and informed opinion, a variety of criteria. 

are developed for assessing the adequacy of activity in each:of the above six® 
-. areas, Each criterion item is classified into one of three groups:.(1) “Required. by 
: — 142," that is, the particular activity must be carried -out as required by 

ous 142. dimen (2) “Desirable,” " ie. while not required, the activit i 


-conductei, woukd- be valuable i in meeting ‘the intent of 94- 142 ragiilations; ane oi 
_ ll “Ideal, 94- 142, = evaluative activities which rettect the spirit of base : 


fbr are ‘set “forth! ‘including. the following: faa communications about the 3 a“ 
-child shouid be written in ‘the parent’s preferred tanguage, (b) ‘Procedures: must ed 
“ss pe ‘developed ‘for situations in which Parents deny LEA's. permission to ‘engage. in 
S “evaluation. activities: with their ehild, (c) there is.a designated Rersort responsible x 
for ‘certifying that policies: with respect” parental involvernent. in evaluation ao 
activities: have. ‘been ‘followed, (d) if known, and/or ‘available, parents. should be- - 
4 provided with the names and addresses of advocates (based on type of handicap, 
\ Sor racial ethnic, or! other. ‘cohsiderations), “(e) snechanisms are developed for 
_ determining parental understanding of what is to be done, and probable benefits 
“and: possible negative consequences of the actions, and (f) parents are involved in: - 
“determining planning and’ ‘placernent ‘eam membership. Using the three. level’ : 
= scheme referred to; above, evaluation criteria a and.b would be classified: as 
~ required to meet. ‘the letter of the law, C. and. d rated as uesirable,. and 2 and f as 
the ideal to- be. achieved. Obviously, judgments about actual: evatuative criteria 
vand their. piacement’ into one-of the. three: ‘categories is subjective. However, a 
"inasmuch. as the criteria are-stated in straigntforward fashion, and the: evaluative * > 
- Categories as weil,. , 1M Cases of disagreements . about cateyorization: it should be 
i possible to: reach: consensus on appropriate item piacernents In. addition to, 
‘developing and categorizing the evaluative criteria, attention ts also given: to such 
 Marters .as valiaity, reliability, and practicality. as well as, when appropriate, the. 
rational and empirical. bases. for criterion development/selection: Actual ‘criteria. j 
_ for assessing. components of the identification- ‘asséssment-placement process are . 
_ Presented | in sections foliowing. : "ss : 


-. | ASSESSING THE ADEQUACY tad, 
"OF SCHOOL DISTRICT = 
"TESTING/ASSESSMENT PROGRAMS 


Background © 
* 
There” is no"speci tic 9a- T42-requirement that LEA’ ‘Shave tortnais zed. ‘provis io <— ~ 
tor securing test/evaluation data. Virtually all LEA‘ s, in tact have such 
Provisions, but they are not always organized to serve 94-142 needs to maximum 
. advantage. .Moreover, as Presently organized, few have built into them the kind | 
of accountability which make them as useful for 94-142 evaluation purposes’ as - 
* they might be. The purpose at the present section, then, is to appraise school . 
district testing/assessment programs in the light of 94- 442 evaluation requires. 
ments: To anticipate, it As apparent that protections need to be ‘developed not 
eonly with respect to test selection and usé; but also at the structural level, e.9., 
~ the manner in which. LEA’ $ are organized to ee test /evaluation data. 


TABLE es 


ASSESSING THE ADEQUACY - 
- » OF SCHOOL DISTRICT : 
TESTING/ASSESSMENT PROG RAMS.’ 


LE valuative Cri terion 


ee, An -identitiaote . “program exists: ‘in the school - 
oe district for securing Gara on student achievement, 
aptitude, and otner péronai cnaracterisiics, ‘of 
cistudenis, presunied: to. be reared to: instruction 
* and/or. _achievernent lie. ae ‘testing/evuluation 
unit), 
. a 7 - 
iProviniors exist’ in “tne. senool district for 
diagnosing. and prescriping with Feapect to the .- 
‘Vearning.- and aajusiment neeas of. -ingividual 
“children. 


sta ies a 
», The purpuses of tne aswoment ‘programs are 
“-availaote in wrirten form, 


. The description of scnool aistrict -assexement 
Programs is maae availaple ta person’, in these 
groups: * . 

A, , District Aarninistrators 
“4. Routinety: 
2. Upon request’ * 
B. Teacners 
1.. Rounnely 
2. Upon request 
Cc. Parents , 
"1 Rouunely 
2. > upon reyuest se 
“O. Interested Citzana/Goeamarty hienadll 


: 2. Upon request 
“-E. Stuaents ~ . 
1. Routinely 
. 2. Upon request 
5. At the district. or builaing level, there is an 
Advisory Cornrmittee to tne standardized (group) 
"> testing Program wnicn is comprised of, representa- 
tives trom tnese groups: 
A.- Administrators 
8. Teachers . 
c. ~-Parenes : 


SS rn re 
Table 1 Continued 


Evaluative Criterion ; 


Required ~ “Desirable. “Ideal 
94142 9414 


* Students 
The Community at large” linetuding advocates | : 
wand: ‘representatives “of groups: known to be 
eee in these eee? 


6. At. the. district or. building level there we a 
“advisory ‘committee to the individualized resting/. 
‘specialized. education program(s) *which, is com-. . : 
prised of represen tatives from these groups: OP 
AL Administrators , 
en - Teachers ee 
: ©. - Parents. 
D 
E 


” 


Students 7 : 

The Cornmunity at large. lindluding advocetes , 
and representatives of. groups known to be 
— interested! | in then: eer 


se ae 


MM KO 


1 ‘At the district, “subdistrict, or building level, ie : 7 
group ‘testing program is organizationally aligned 2S 
| directly with: the: district ‘sfouilding's. instructional - 
“departenent/unit. 


8. At the distrio’, subdistrict, of building lent, the a“ Om 
bs individualized testing assessment program is argani-; ss 
zationally aligned. directly with. the districe's! . 

‘building's instructional department/unit.. ; 


y ote 
‘ 


"9. For, any ‘single grade.levet date are. available cn ON 
: student “achiewernent in relationship to ‘the : - 
% following: i “ * oO ae & 

A. The district as a whole i 

~B.° School buildings ad 
‘CG. Classrooms bs - 

DO. Major racial groups, 

‘é. Sex... : a. 


Fe 


: 10. "hen are written provisions and tormal structures “et 


for ‘utilizing group evaluation results in instruc- . Sas 
tional plarining at these tevels: ; : 
AL Diswiet. m4 3 oe “ 
B. Building - a ae a 
-C. Classroom 8 * aK 
vt. There. are written provisions and format structures — : : x | 
for utilizing the results in, instructional planning . . : = 
with individual students. : am 
42. Asiessrnent personne! have been trained to work * | = — x 


_ with. students oft diverse economic and cultural 
‘background. a : : 


4 Sy 


y 


Evaluative Criteria Ww eS 

bo . . - at i. % : oe Mi 
Criteria for assessing the adequacy of LEA testing/assessment programs are: 
__ bresented in Table 1. Key.elements of: the critieria are that an identifiable 


_ Program for securing tast/evaluation data should.ne present’in an, LEA, that 


: ‘information about it shouldbe available in written form: to school personnel, 


students, parents, and. citizens that it should be organizationally aligned with the x 


LEAS department of instruction, and that there should be associated: with it a ee 


(them, if separate LEA ‘programs exist for individualized, and group testing! 
assessment programs) an advisory committee comprised of representatives from: - 
| taachérs administrators, parents, and students: The program would specify what” 
" tests ere given to whom. when, for what purposes, and how the results are to a 
used. 
Ne 


a 


Discussion . 

aT might appear, at>first: blush, that 94-142 evaluation activities concern only. 
individual tests and assessment procedures. Such an assumption is incorrect. In : 
‘virtually all LEA's, group testing prograrns and individual testing programs are 
interrelated in the sense that-resuits from group tests are sometimes thé first 
level of identification of children who may neacdt specialized services. Moreover, 
any composite eduéational picture of a given child inciudes group test xesults. 
The role of group testing programs in 94.142 evaluation activities, then, must be 
given .as careful attention as is given to evaluation materials desigged to be ms 
administered to individual children — a Seriously overlooked fact. The problem 
would be tess serious if careful attention were paid to the criteria for test . 


" evaluation and use presented in Table 4, but/typically this is not done. Consider 
- only a single: criterion used to evaluate tests. that of reliability, which refers to 


\ 


Qo. 
ERC 


the consistency of measurement. Measurement authorities note that if decisions 
are to be made about the achievement gains and losses of individual Pupils, the 
reliability coefficient should be at least -80 (though obviously information useful 
for ather purposes, 2g. group comparisons, can be obtainad from tests having 
‘lower reliabilities). .and parallel. forms of the test should be available. 


. 
. 


As has been noted elsewhere (Jones, 1973), it is reasonable to ask, asa purely 
empirical question, how many extant ‘schoo! achievernent tests have parallei 
forms, and reliability cuefficients of at Jeast 90. An analysis of some 1,649 
achievernent tests and measures for use at the alamentary school level was 
undertaken by the Center for the Study of Evaluation at the University of 
California, Los Angeles (Hoeptner, Strickland, Stangei, Jansen, and Patatino, 
1970). A representative sample of their findings were those obtained for 141 
” istendardized reading tests appropriate for use in gracile 6. Of the 141 measures, 
105 (74 percent). had either rio parallel forms, or parallel forms with reliability - 
‘ eoefficients of less than .70; only 7 of the 141 measures » bossessed reliability 


21 ae 
Kd . og 


a 


“ coefficients ‘of .90 or higher. Moho. Hoepfner and chis associates judged ear 
112: (79 percent) of the tests had norm groups Wain: were rated é as local, poor, 
or outdated. ; 

- White no aepliclt reference has eee made to group tests and evaluations in | 
Y94.442. {although . not stated -explicitly, the language. of 94-142. requlations 

_ suggests. strongly that the major concern is with tests of intelligence i in. general, 
ncaa those that are.individually administered), it-is apparent ‘that as muche 

_ attention: t jeeds to.be given to ‘the use of group. aes in the assessment/olacement 
pegeess as to individual ones, . : : 


ok critical’ jeature at an accountability: system would: seem to hes san advisory 
committee (s) to LEA testing/assessment/special education programs. Many of 
- the issues related. to: 94-142 evaluations® were i in part stimulated by parent. and, , 
“ community concern about special education testing, | assessment, and placement 
practices. Advisory committees of: citizens, parents, children, teachers” “and. yee 
administratoas to. LEA testing/special education programs, if made, alia a ’ ate ey 
-. would do much to demonstrate LEA willingness to respond to commun ; ; 
: demands for the reform of certain. practices. Where such advisory” committees 

have been instituted (both ‘at the district and at the building level) they appear 

to have worked to the advantage both of. ne LEAs. and. the educational program : 
(Jones, 1976). - 2 : 


A final isalie concerns the role of testing and evaluation activities in the district's 
organizational structure. In the typical school district, standardized testing and | 
“assessment is conducted for several purposes: to evaiuate student achievement’ 
“for purposes of comparisdn among schools within the LEA. between LEAs or. 
-against a national standard, to meet the requirements of funded projects {e.g., 

“Title | ESEA), for placement within regular classrooms, and for placement in. 
‘| .* special. classes. a2 3 . s S : : 


‘There should be an LEA philosophy about the purposes of formal testing and 

4 assessment and also an administrative structure to accommodate the philosophy. — 
‘While recognizing that test/assessment results may be needed for administrative 
~purooses. (e.g. Titles| evaluations, etc.) it would seem that. district statements.of.._. wiieedc, 
"philosophy should emphasize the view that tests and other formal assessments ‘ 

» ate .administered:conducted in order _ to plan instructional! «programs for 
individual students and to monitor. achievement and skill development — 
requirements which are at the ‘heart of 94. 142 evaluation. procedures. The 
adoption of such a point of view would suggest that responsibility for 94-142. 
assessment activities (especially in relationship to apprarsals of individual 
students} “should reside, in the final analysis, in the LEA’s Department of 
Instruction and - not, as -is sometimes the case, . in’ LEA. departments ’ only 
indirectly related to instructional activities. ; 


PARENTAL PARTICIPATION 
IN EVALUATION ACTIVITIES: 


Bee «gd ‘ 


Background —  * . _*, ee. re 
While no. specific mention is made of ‘Gaental ee ie in the evaluation 
process. ‘as discussed in. section 121a.530- 121a$34, active parental involvement 


involved. Parental participation i is required in-the development of IEP" s however, 
and it is in this context that evaluation data will most likely be presented. What 
- = “ey follows. then is a-discussion of procedures for‘ ‘ensuring paféntal particivation in 


sin evaluation activities is implied nevertheless.” For example, the. requirement : 
Re ge (121a, 533): that the placement decision: is to be made by a group of persons, 
~~ ineluding those knowledgeable about. the child,..impties. that: parents are to be. 


the meetirig(s) in: which evaluation findings are presented, most Probably within . 


tee context of developing TEP ’s, - ~8% 2 4 
- x 5 ~ . 


. Carrot, Guns, Hinadale: ‘and ‘Metntyre (1977) state “hie benefits to pafental 
* involvemerit inthe assessment process quite well, They observe that ~~ 


eS 


Parental. involvement in the assessment process: has been shown 6 have as 
immediate benefit to special educators. For instance, it has. become apparent 
that ‘the darents of children in need of intensive assessrriant may be enlisted i in 
becoming valuable sources of diagnostic information, especially with regard: is 
the child's peer “and family interactions, health and piay habits, developmental 

* history and: medical history. Moreover, parents who become actively involved 

In the assessment procesé: often. are willing to’ assist in actual. program 
implethentation, thereby providing a sense of continuity between home and 

» schoo!, Finally, parental invaolvernent in assessrnent and programming adds .9 
new dimension to the concept of. accountability in educators — the direct 
accountability of educators to the parents whose childcer? thay- ‘shape. In the 
context of culturally appropriate assessment, this accountability to parents is 

: particularly meaningful since it implies pec quarablticy to ane child's cultural 

at, “and linguistic heritage as well (p. 323). : 


Evaluative Criteria : 


wad 


¢ 


Evaluative cfiteria that “might. be_used to assess. the. ~degree.. ets parental 


“participation in evaluation activities and the evaluative process ate presented in 


rationale for parental involvement. Additional criteria relate, to the need to 
protect confidentiality tights, to develop guidelines for ‘securing “parental 
.S permission to engage in evaluation activities, to ascertain. whether: in feet Parents 
actually understand clearly that to which they: give assent, including Probable 
benefits as well as possible negative consequences, and to make provisions for 


securing information on parental perceptions, prégrences,. and expectations. 


Finally, provisions for ensuring acdountability with respect. to implementation of 
LEA policies concerning parental Participation: are @ made, cand a detailed set of 


wn 


4 .® nes 


‘Table 2. Key criteria revolve around the need, first, for’ LEA's to develop a 


TABLE 2 


St 


_ PARENTAL PARTICIPATION ; 
LIN V EVALUATION ACTIVITIES - 


a = 3 Pow . 2 


Evaluative Criter fon. ue ‘Required. Desirable oe rn ee 
Da occ aia 5 4, ke ws ‘ge142’ 94.142" 


: 1, wn ‘rational, model “for involvement aks pareots ni ae : yas ed 
evaluation” ‘activities has been developed/adopred ee : 


~ - 


Erne district. . a ‘ 8 ‘ 


— the district level: Se ee ee 
A “There are designated persons. vehoncan answer cr : YX 
parent: and: community questions about a 


wy 


Le evaluation activities. . : 2 
B. There is a designated person with: -authority . * ise x 
‘and responsibility for certifying that district. . , 
procedures for commurficating with=gynd 
- involving parents. ‘in Sreluanons activities ne 

No peen followed. ys x 

e Procedures. have been developed for situa- a se 

"tions in,.which parents deny permission to es ane 
engage -in. evaluation activities with their ee : 7 
hid es 


3. Prior to any. written communication about child 


gx at ‘evaluation activities, parental preferences for the: 
following are determined: : s 7 
A. The language of written communication 4 : 
“B. The language of spoken communication /* 
C.. Meeting time, .. ; ~ 4 4 ; 78 . a 4 a 
D. Meeting place : a a a : , 6 
._ th the parents preferred language and prior to the . * a oo, 
ynitiation of any evaluation activities, the ‘child ea a cis 
~ parents/parent surrogates, the written notice: a 
A. ts written in language-understandable to the = |X” an 
general public, ie., be free of educational, : : ates 7 
-medicat; and technical jargon Hanguage: , ; ; * as aa 
+,  @ Inctudes an explanation of due process x , & aa 
procedures and confidentiality Fights as they 2 
_ relate to.the proposed activities. . : a 
se C. Contains # description of the proposed 7x 
ee action, why it is being proposed, and the 
: options curriintly or formerty under consi- : 
_ deration. _ — . . ‘oe 


Py 


© Table 2 Continued _ 


a. 


7 Required Desirable Ideal ° _ a 
=_ 94-142 - 8 Odd? 


D. Provides a description of each eveluation X as 
: procedure, instrument, record, or report to ~ v : - 
be. used.or generated dum be activity. : es 
Ez" Informs parents o so refuse te . X ; — 
me participate in the a a : 
F. Provides parents we eis), title(s), »: x 
address(es), and: relep rone-thumberts) ot | . 
personte). who can answer. questions directly. 
related to parental concerns: * : yy 
G. Provides ‘parents. with the names, addresses: a " X 
and telephone numbers of advocacy groups = % 
having ..interest in problems of the same or. : 
- presumed nature as that/those under consi- , 
deration and- “who have expressed @ willing. 
ness to communicate with parents on paar 
ie 


these rnatter{s), = * . = ; 
H. Informs parents of their ghee to seek a third x . vs ane 
~ party. independent evaluation, at district : 
expanse. ; oo 
’ 
5. Mechanisms are provided for assurances that - ae 
—— parents demonstrate an understanding of: 7 ; ” os 
ss AL What is to be done x. 
O° : 8B. Why it is being done. x. 
- C. ‘How it will be done * x 
7 OD. Peetiable positive benefits of procedures/ x 
i: "actions, ~ So 
« : E. Possible negative consequences of proce. . x 
, , duresiactions...-~ ey : 
F. Uses: - to... ‘be made of the information —_ om. 
obtained. ; . 
= . 6. Wrirren communication from 1 parents indicating x § 
eine eee eerencons nee A SSONT tO Fequest to. undertake assessment Seas 
. activities. 5 ; 
. 7: Mechanisms for demonstrating parent agreement . x 
~ with: 2 : . = 
A. What is being donei: , a x 
7 8. Why it is being done x 
Cc. How it will be done x 


as : . 


2 oo B School districts insure that principles of contiden- 
: tiality ara observed by making certain that the 
following take place: ~ 


“@ . ‘ NS 


: & 


Within. - 


, Evaluative Criterion s 


a 


That parents and guardians nave. access to 
“personally ee record _ keeping 
systems. = + 


“That there are detined | and publicized means” 
~for, the parent (and _chitd)-to find out what- 
information is on” 
record, who put it there and how itis being” 


personally identifiable 


used. fs JN 


That means are provided to keep information — 
> that was gathered for one purpose: from ote 
, ‘being used for anther. es 

+ That. there is @ ‘defined and publicized , 
> procedure ‘for .correcting, amending, _ and 
~ challenging records. 


That school districts must assure y the valiaity 


and reliability of data for their intended use _ 
" and take precautions to prevent there misuse, ~~ 
“preventing possible © - 
“misuse Of data are available ‘in written form. 


That procedures ‘for. 


That a record is kept of persons who have 


“had access to records by their name, pate of 


access, and Duper. : 


“the context ot evaluation activities, 


information is solicited from parents on: 


A, 


& 
1. 
Ee 


OOM > 5 


. Their perception of the probiern 


Their child's behavior . in the: home ‘end 
community 

The child's language dominance 

Perceived strengths of the child. 


~ Parental expectations and goals. 


q parents are involved: as “full partners in all ot 
“virtually all. planning and placernent ‘activities _ 
including: > “Se 
Determining PPT membership 7 


Delegation of agreed upon PPT tasks 


Structuring of agenda 
Use- of student needs as guidelines for | 
. judging programming alternatives : 


Suggest student subject matter needs 
Influences others to ‘accept a 

program Se 
Suggest instructional methods*for student. 


specific 


Required’ Desirable 
94-142 


‘Ideal :. 
4 94-142 ace 


33 Evaluative: Criterion’ 
- an 94-142. "94-142 


: ° 
ar ‘i + 


oH, Evaluative naiteavanvelel’ trom the parental i 

Ses perspective. . ty _ : 

chs. Review the: student's educational ¢ progress. ewe gk rae “ 
J. “Review the. continued _approoriareness of the ~ , : y 


Student's ‘educational program, : 

. Present information relevant to the case. .- 

* Gather information relevant to the case. 
“Interpret informarion relevant to the case.- 
Summarize information ait case. 
Encourage others to participate. _ i 
_ Critique rnembers’ actions. 

Keep group on task. 

Resolve conflicts of opinion. 

. Establish Fneeting dates. 
Set date for review of. aa discussions. oe 

: Finalize decision. : %. : : 
Set evaluation criteria for. student’ $ aeeenie 
performance in the soecial education : ro ; 
gram ct 48 : 


SCAM DOPOZET RK 
xx XK KKK KX 


UX 


s . . ; a 
Vt. Whether. active partners in PPT activities or not on Meg 

" parents are to be given written notification of all ; 

assessment findings and given the opportunity to 

react: to- ‘thern prior to decisions pout services to 

_ be given or-case aieinon . 


Major Sources: Yoshida: B. K., Fenton, K. S.,-Maxweil, JP, and Kaufman, MoS fd 


od. Parental involvernent in the special education pupil planning process: The. 
a school’ $ perspective Washington: Bureau of Education: for the _Handicapped, 
- Division of Innovation and:Developiment, State Program Studies Branch. No data 


2 


(c); and Carroll, A. Gurski, .G., Hinsdale, K:, and Métntyre,- K. Culturally 
appropriate assessment. A sourcebook for practitioners. Los Angeles: California 
Regional: Resource. Center, ees 


ay 


Required. "Desirable . “Ideor =e 


2 


“criteria, for assessing “actual degree: ‘of: parental participation in’ "planning and 
“placement team activities given. 


The: first evaluative criterion: ‘states that, ‘ideally, an- LEA qFiéutd dicate fetent a 
rational model for: involvement of parents in evaluation/IEP.. activities, This. 
means, simply, that LEA's. ‘should formalize their thinking. on.the point(s). at 
“which. parents will be involved in. evaluation/1EP activities and ‘the benefits and. 
“possible disadvantages ‘associated. with Various levels of participation, Yoshida . 
_ and Gottlieb (1977) ‘have. given: attention to. these matters.and have developed as 
: - three stage model . — input (‘ ‘school. Staff gathers psychometric, academic, social, 
familial, and medical information required:to make a decision’), process (The > 
case . conference(s) of. the placement. committee considers and: evluates this ° 
. information”) and. produce (“A-decision is made which provides an. eligibility 
statement. and educational. plan for the student") which quite comprehensively Det 
provides a framework: for determining ‘degree and kind(s) of parental participa. 
‘tion, Possible roles for parents in each stage are carefully examined; In the input ° 
. oe phase, for example, 94- 142 requires that parents be permission givers. ideally, 
: _ they: ‘should be involved as information and preference Givers as well. Inasmuch: 
as 94: 142° requires parental involvement in [EP development they are involved i ine >. 
“<2 the process phase also. THé benefits and costs associated with an active (ora. 
e passive} role in the process is Something that a district .will deed A think 
through. a: . 


- Seligeal authors tay: Carroll, Guiski. Hinsdale, and d Mcintyre, 1977: and Yoshida 
and Gottlieb, 1977) suggest that the home visit may be an important source of 
information for ‘use. in the assessment/IEP development process. While this is ° 
~ true, several precautions must be taken, particularly when middle. class : 
professionals visit the hornes of lower SES and racially ‘and ethnically different 
Clients. There are. at least two potential problems: (a) securing information to 
’ evaluat, and {b) evaluating the information: secured, A perspective on the latter 
“potential problem has eon aN ven by White {1972 pene writes that 


“A simple journey with. the white researcher interviewer?) i into the biack home 
may provide us> with some, insight into how . |. erroneous conciusions: are 
reached. Ouring this visit to the. black home the researcher may not find 
““tarniliat aspects of white cuitaee sueh as Bouk-a!-the Month selections. records es. 
of Broadway plays. classics, Magazines such as Harper's, the Atlantic Monthly, 
_ or-the New York Review of Books. He might aiso cbserve-a high noise level, 
“continuously teinforced by ‘innut fram blues and rhythm radio stations, TV. 
> programs, ‘and several sets of conversations going On at once. This tyr of. 
~ abservation jeads him: to, cassume_that the homes of black children -are very 
weak in ineellectua). content, uninteresting,.and generally confusing places to 
grow up: Somehow he fails to see the intellectual stimulation that might be 
provided by local black newspapers, informative rapping, Jet, Ebony. Sepia, 
and the Motown sound. Black children in these sare hodars who supposedly 
- can’t ‘read leven preschoolers) can sing several rock and biues tunes from 
memory and correctly identify the songs of popular entertainers. These sacne 
ioe : 


Saelta “researchers or cational: Psychologists listening to black cobech axsurne that 


oe our, use of no hdard” oral English i$, any example, of bad grammar without 
. recognizing the Dossibitity that we have a valid. ‘egitimate, alternate, dialect 
ore, 1972, BP. ae 


vous. and Gottlieb (1977) warn. of the “possible danger’ in the interview . 
: “situation, that. the parents” may, describe their child’ . home life inaccurately. tn. 
wath Jight of White's analysis wgsthust. be sensitive as. well to the fact ‘that the © 
rviewer “may interpret v we hes sees. and hears inaccurately. 


a Some aie believe that, etna ex terit possible, interviewer and interviewee — | 
racial “background “should be matched. In summarizing research .on the © 
"_ finterviewer-interviewee match, Weiss (1975) concluded that “current evidence.” 
suggests that,: -on al: mited range of race related questions, matching interviewers 
to: respondenis 1s advisable in. the cause of: accuracy. ‘But for. most questions” ine 
* most places at most’ times, a “good interviewer is: a good interviewer. ™ It should 
be T noted. that Weiss- generalizes froma limited range of stuclies, many of. which. 
. > are quite old (20 yeafs or more). Changes i in interracial climate during the past 
> decade, the: sensitive issues being dealt: with, and ‘the attitudes which some. - 
. groups lespecially® racial minority: group: members} hold toward the’ possibility of 
“special education placement: ones and Wilkerson, 1976) suggest, Particularly in. 
, dealing with | special populations, that in the context of home visits, attention bee, 
"given to interviewer characteristics. . 4 
. a i 
tt would seem, ideally, that parents” cught, to. have an active role in the 
. deliberations. Criteria designed to appraise parental participation are designed 

“with this point of view in mind, ie. active parental participation, Thus, at the 

~ point of initial contact, parents need to be intormed of what is to be done, how 

“it is to be done, and how the information isto be used. Also, they should be 
informed of potential positive outcomes associated with the procedures as well . 
as possible negative . consequences, . “Utilizing data fram Yoshida, -Fenton, 

_ Maxwell, and Kaufman's (no date. c} investigation of parental involvements in the 
special’ aducation planning: process, a variety of criteria which can be. used to 
assess parental involvement in-evaluation/IEP. activities are presented. It is 

“unlikely that. thost LEA's will be able to resnond affirmatively to all criteria ; 

listed in Table 2.. which reflect. -ideal_and.maximum_oarental_involvement..and..__..-. 
participation. However, the criteria do represent a set of guidelines which. an’ : 
LEA can. use to” organize its. thinking . about desired degrees of parental 
involvement and participation, “Also the criteria can be used by the. LEA to 
determine how wel it has. followed the guidelines developed. 

Obkiouay. LEA's need models of ideal participation in evaluation/TEP activities. 

They also nee’ riteria to determine the extent to which minimally acceptable 
objectives have been met. “At the same time, LEAs must realize that a number of 
tathors (both positive and negative) have to be considered in decisions about 
“degree and kind of parental Participation in evaluation/IEP activities. Yoshida. =~ 


S 


“and Gottlieb (1977). shave summarized ‘these considerations exceedingly well, 
ey write: es era bs 


, “Assuming that greater parental participation in the-decision making apparatus. 

__ is. wassociated with increased tultiliment of due process guarantees, what are 
“some of the gains and losses that can be anticipated? On the positive side, 
parents may not reject school placernent decisions as often, thereby reducing , 
_the number ot due process nearings (Kirp and Kiro, 1976). Also, parents may 
“become | more receptive and tess hostile to the schoo!" 3 demands, especiatty — 
-when. they are invoived: in-placing ‘students in special classes. Finally, parents. 
> may be taught, ‘methods for dealing with the child in the home, thus fultitting 
the “home-school” team effort so‘otten advocated. This. team relationship, = 
. May becorne “necessary. as parents are reuuired to be present during the a. 
development | aft the individualized education plan as proposed in 94-142. 

However, there may oe certain disadvantages that accompany . perental 
involvement. Greater participation may also” mean. more opportunities for 

parents to observe tne system, and they. may conclude that scnools are not 

Operating in the best interest. of their chitd. More importantly, the presence OF de 

‘parents may require major cnanges wn tne’ commitree’s handling: ‘ot: the case, 

which may. affect the aegree. ‘of openness with which mempers ate opinions 

Sand suggest ‘solutions. These costs and benefits must be weighed “when, defining 

the parent cole, . 


et 


ag .e va 


These efforts to increase parental invorvernent | ite determining the ectucational 
~ placernent.and. prograrnming of their child facus on iegal procedures which: . 
_ MeCessarily, must be. tonowed. However, fultilting legat criteria should aot be 
equated with remedying the fundamen tg ‘problem which due process was 
intended to relieve. Do these -procecurés result in educationally sound. 
“practices which increase tne student's achievernent and adjustrnent? Until this 
question is answered positively, Drofessionals and laymen alike should be 
cognizant that improvement in due process procedures does not necessarily 
imply a concomitant improvement in educational pertorrnance among those 
the litigation and legislation was designed to halp most — the pupils (Yoshida 
_ and Gortliat, 1977, 9, 20). 


DIMENSIONS OF ASSESSMENT 4 - Bo 


ere protection for the student requires that assessment be comprehensive. 
‘The regulations are explicit in stating that the evaluation is to be made bya 
‘multidisciplinary team or group of persons and that the child is to he “assessed - 
‘im all areas related to the suspected disability, ‘including, where appropriate, + 
health, ‘vision, hearing, social and emouonal status, general intelugence, 

; academic performance, communicative status, and motor abilities.” In the 

_ present section -evaluative criteria are set forth for determining ‘whether in fact” 
“provisions have. been: “made for sees comprehensive data in areas pigs to 

~ the child’ $ Neary. ¥ 


— 


Evaluative Criteria a . 


*” secured.in part perhaps because it is- difficult to obtain. A final item requires 


AS is well: known: teacher reports, particularly of child behaviors and social . 

performance may be subject to some error. The caftrext is important if behaviors 
: * are to be interpreted accurately. The evaluative dimension related to the direct . 
cobservation (by persons other thar the teacher) of {a) ‘the classroom manage: 


ow” 


‘Tne criteria presented | in Table 3, drawn directly from: the regulations: and other : 
; "sources, are. meant to represent areas that~ might be" given attention in any 
* comprehensive assessment of a child. tt is unlikély that all-of the dimensions will 


‘observations ig not ruled out. Provistons are available. for. securing. information on. 
\ the: child’ s cognitive, 


Discussion 


Personnel. To be sure, there are. problems with observations in the above areas. 
There is first the question of relevance. While classroom behayigt 
" categorized ‘on a number of dimensions it should be established that the 
. dimensions on which assessments are mace are related, 


. the present context this concern needs to be extended to the reliability of the _ 


. inter-observer reliability must be obtained. Thisft 


be necessary for each child who is the subject of study, but many will be. 
Teacher reports. on children are ‘required by 94.142 regulations whereas direct: 
observations of the. child in the classroom are not, although the need for such. 


language, - social-emotional, educational, and anyden “ . “s 
functioning, but that related to the family and cultural environment is often not 


formal attention to each evaluative item in Table 3 by the planning and. 
placement team. Such a requirement builds a into the evatuative - 
process. ; me 


Sy 


ro 


ment system, (b) student teacher interactions le) student peer interaction, and 
(d). the child himself, may suppternent data from the. teacher and other school - 


er 


can be 


in some way, to : 
Tmeaningful aspects “o§ the school experience. This is not always the case for 
‘observation systems, even those developed -to provide information about a 
child's performance in the school setting. Second, once a system has been agreed 
‘upon, there is the practical problem of who will conduct the observations. It 


é 


Must be acknowledged that any observational system proposed will require 


Goneigerabiy more personnel than now exist in ae s for such purposes. 


"There is ‘conegrn in 94- 142,” and justitiably so, about the use of a single 
instrument or procedure for acquiring data‘*on any dimension of.interest. Within 


observations made. Obviously, if there is to be confidence in the ratings, 
equirerhent again dictates . 
additional manpower needs. Despite the fact that obtaining observation. may be 
expensive and time consuming its ‘value and importance should not be. 


‘ underestimated. By giving attention to the context in which behavior occurs and 
to classroom dynamics, 


@ more adequate assessinent is likely to: result. 


TABLE 3 


DIMENSIONS OF ASSESSMENT 


Evaluative Criterion “Required Desirable Ideal 
me 94.182. 94142 


Y 


“1, For each 94-142° activity involving individual 


student appraisal, there are: “LEA provisions/guide- 
“tines to ‘insure: tormal consideration of the 
follawing Kinds ot information: © 
~~ ‘A. Teacher reports, af child's 
T. | acaderaic performance 
2. -behavéfiral performance , 
3. sacia! ‘performance a ; oe x ie 
B.- Direct classroom observations >> ay oe me 
1. classcaom management system a 
a. evaluation of learning rate accom: 
modation ; 
b. evaluation of child's cognitive style 
: ~ c. - evaluation of curricular content 
ute > od. evaluation of classroom = environ- 
: el te ea - coe 
2. Student-teacher interactions : . x, 
3, teacher verbal reinforcement pat- ~ : - x 
Sa terns ; : : 
ae oO b. teacher non-vertiai rainforcernent . x a 
ae - parterns + 8 
- > G. teacher bilingual interactions i . x 
Student-peer interactions mR a 
a. reports of observations of child | in oe 4 
. group settings 
_-b.  raborts of observations of child in x 
: relationship to group norms: wo 
4. Direct observations of child - : x. 
&. specific target behaviors ° oo x 
@ 5. locus of contrat 
Ca, Educational functioning 
. 1. achievarnent in subject areas, 
2. learning style(s) : x 
3. strengths and weaknesses ; _* x 
D.- “Sociai-emotional functioning . 3 ‘ 
: 1. ‘social-psyshological development 
a. attending receiving 
b.  rasponding 
-c. valuing 
d. organizing © 
©. characterizing 
2. selt-hetp skills 


~ 


xx KK KON 


ee 


Table 3 Continued 


Resource Center. 
practitioners. Los Angeles: 


Evaluative Criterion 


€. Physical functioning 


T.. visual : ; 

2-. hearing ‘ ‘ a 
3. “speech a 

4. motor‘psychornotor . 


a. gross metor 
3b. fine motor 

5. medicat ‘health: 
F.. Cognitive functioning 

1. inteitigence 

2. > adaptive behavior 
@ 32. thinking processes 
nnowledge 
comprehension 
application 
analysis - 
synthesis ‘ 
®aluation “ - 
SG. Language functioning 

1; receptiva ~ * 

2. axDressive 


"ese e 


3. nonverbai : ; 

4. speech s 
H. Farnity 

1. dominant language. 

2. pacentcniicinreraction P 


3. sewial service needs 
1. . Cultural and Social Environment 


1. horne aa * 
2. interpersanal 
> 


. Material 


There are -designated LEA personnel. given the 
responsibility for certitying that each of. the above 


-assessmant dimensions (A-1) wat formally consi- F 
_dered by placement and planning teams andeither. ee ee 


utilized: or rajectad as unnecessary in the case under 
consideration, inthe latter instance, 8 brief justifi- 
tation for non solicitation /nonwutilization of the 
mraiustive dimension is given. : < 


Required 
94-742 


x 


Major sources of criteria in the uate table are the following: California Regionai 
Culturally appropriate assessment - a sourcebook for 
California Regional Resource Center, 


: ideal 
94-142 


<M XK XK KX 


xxx x 
a 


1977; and- 


lee " National Association of State Directors of Special Education. Functions of the. 
placement committee in special education — A resource manual. Washington: 


National Association of State Directors of Special Education, 1977. 


‘Fortunately there are a number’ of sources.of information on observations, and 


+ observational systems, several of which have direct relevance to special education — 


_fe.g., Carroll, Gurski, Hinsdale and Mcintyre 1977; Lambert and Hartsough, 


1971; Latnbert, Hartsough, and Urbanski, 1976; Urbanski, 1976; and Weinberg 


ee Woods,. 1975). Systerns for Assessment of social- -psy chological development 
~ and cognitive functioning. (with speical education relevance) have been devel- 
_ oped as well sBloamn, 1956; Krathwohl, etal. 1964): 


teas a. 


~ 


“<0 #ESTEVALUATION AND USE > 


*. 


Background _ a 


ae evaluation procedures. The ragulations state that ‘testing and evaluation 
proce lures used. ‘for the Purposes of evaluation and placement of handicapped 


a Moreover; tests and evaluation materials mustbe provided and 
administered in. the child's native language, or other mode of communication, 
. have been validated: for. the purpose for which they are used; ‘be administered by 


thread running through concern with evaluation procedures is, simply, that they 
be valid for the purposes fo? Pron they ara used, While simple in conception, 
there are, it is to be regretted, a number of difficult problerns of implemanta- 
tion, Criteria presented in Table 4 then should be useful in assessing test and 
assessment instruments far degree of bias. 


Evaluation Criteria 


3. 


inappropriate test use is due inrgaby 4 to a failure to cordently anny existing 


standards. In this section, therefore, no new or innovative criteria’ for test 


appraisal are presentede Rather, the test user is directed to relevant aspects of 
Davis’, Standards for educational and psychological tests (1974}. lf applied as 


_ to, the general population, ta racial and ethnic minority groups. to the 


~. which can-be anplied to the evaluation of tests for any pupose and which can be 

used with any group. Nevertheless, certain pringiples are highlighted in Tables 5, 

6, and. 7 which.treat, respectively, considerations related to test” use with 

; minority group/low SES populations, the handicapped, and preschaglers — 
populations of special interest within the context of P.L. 94-142. 


"Fairinon-discrirainatory use of tests is at the heart of 94. 142 protection in. 


- children ‘must be selected: and administered. so as not to be racially or culturally 


: trained personnel, and be tailored ‘to areas of Shecific educational need. The | 


they should be the standards will be useful in selécting tests for administration 


" handidapped, and to preschoolers. What follows then (Table 4) are standards ; 


~ “TABLE 4 


"TEST EVALUATION AND USE: 


~ OVERVIEW: 


% » 


Evaluative Criterion 


ee 


1. SEAS and LEAs will insure’ that all persons using . 


tests in connection with 94-142 activities 
understand that: : ; 
AL 


When a test is publisned or otherwise made 
available for operational use it should be 


“accompanied by a manual, which among 


other things, provides information required. 


to subgtantiate claims that have been made ~ 


for its use. (Al) Essential. 


. The test manual should describe fully the - 


‘development of the test: the rationale, 


-Specifications. followed in writing items or 


_ Selecting observations. and procedures and 


results.of. item analysis of other research. 
{A2.) Essential. 

The identity and professional qualifications 
of iter writers and editors should be 
described in instances where they are 
relevant: for. example, when adequacy. ot 
coverage of a subject marter achievement test 
cannot approoriately or practically be 
measured against any external criterion. 


{A2.4,) Desirable, - e x sy 


3 


The manual should call attention to marked 
influences on test scores known tobe 
associated with region, socioeconomic status: 
race, creed, color, national origin, or sex. 
{B1.3.) Essential. : 


“The manual should draw attention ‘to, o- 
Warn. against... any..sem@bus error of interpreta. 


shown to be frequent. (B1.4,) 
Essential; sO 
The manual should state explicitly thd 
purposes and applicdtians for which the reser 
wy recommended. (B2) Essenriai, 


35 


Required Desirable Ideal 


m a 94-142 > — 


_— 
“CH 


94-142 


Letters and figures enclosed in parenthesis (Al., A2.4 etc.) represent the 
identification of the avaluative item as reported in Davis, F. (Editor) Standards. far 
educational and psychological tests. Washington: American Psychological Association, 1974. 
Adjectives following the entry, e.g. Essential, Very desirable, etc. represent the importance 
of the item as judged by Standards authors. 


Le. 


‘interprat 
- desirable. 


we EE SBAN Babe 6 6 oo ae en meee pare 
Instruction should prepare the Satomi for - 


use of answer sheets or 


Table 4 Continued ae : -- 


The test manual should. describe clearly the 
psychological, ectucational, _and other reason- 
ing underlying | the test and nature of the 
characteristic it is intended to measure. (B3.} 
Essential. : 

The test manual should identity any ‘special 
quatifications Tequired to administer the rest 
and interpret it properly, (84,) Essential. 


Where a test is recommended for a variety of 
. Purpases or types of inference, the manual ; 
training 


shouid indicate .the . amount of 
required foreach use. (B4.2} Essential. 
The .manuai should draw the reader's 


attention to references with which he/she’ 


should become farnitiar before attempting to 
the test results. (B43,) Very 


Evidence of Validity and reliability alona 
with other retevant research data should be 


presented. in support of any claims bejng. 


made. (BS,) Essential. 


“The manual should differentiate between an 


interpretation applicable ‘anty -to average 
tendencies of ‘a group and. one that is 
applicable to an individual within the group. 
(B5 4.) Very desirable, . 

The directions for administration should be 


Presented in. the test manual with sufficient 
“ciarity and emphasis so that the test user can 
’ duplicate, 


and will ~ ‘be encouraged to 
duplicate, the adrninistrative conditions un- 
der whigh the norms and 
reliability and validity were obtained. 


the examination: Samole material, practice 
punched cards, 
sample questions, etc. should of ‘provided. 
{C2.) Desirable. 


Norms presented in the test manual should . 
‘refer 


to. defined and clearly described 
populations. These populations should be 
groups on whom test users will ordinarily 
wish to compare the persons tested. (0d) 
Essential. 


oe] 


- Required’ Desirable’ Ideal 
94-142 94.142 


\ 


the data on * = 
(1a 


Table 4 Continued- 


“. . Evaluative Criterion a. Required Desirable Ideal 
Se ee ane - 94-142... 94-142 
: ; ; r ‘ 
P, The ‘test manual-shouid report the method of ae , YX , 


sampling from the population of examinees 
“and should discuss any probable bias "in the 
’ sampling procedure. (D2.1.1..) Essential. : ; 

+ Q.. Norms reported in any. test'manual shouldbe X 7 4 
based on weil planned samplings rather than : oe 
on data collected because it is readily: OY 
available, Any. deviation from the olan ae 
should be reported along with descriptions of ?’. 
actions taker or not taken with respect to 
them, (D2.1.2.) Essential. : 

R. A test developer must provide evidence of x “ 
~ the reliability and validity of his/her test: it is 
usually reported in the test manual. ; ; 

S._- A manual or research report should present : x: ad 
.the evidence of validity. foreach type of ; 5 
inference for which use of the test is * 

“~3.) recommended, If validity for some suggested 
interpretation has not been. investigated, the. ; Lo 
fact should be made clear. (E1.) Essential. = ~~ : 20 5 

T. Statements about velidity should refer to the _ x 
validity of particular interpretations or of: 7 
particular types of decisions. It is incorrect 
to use the Dhrase, “the validity of the test: 

‘no test is valid for all purposes or in ale ; ; 

— _ situations or for all groups of individuals, SP & oe 

(E11, ) Essential : 
“= UU. The test ‘user is responsible for marshalling x 
the evidence in support of his/her claims of 
< validity and reliability. (E2.) Essential. sean 
“VM; AN measures of criteria should be dascribed - ; x 
completely and accurately. The manual ‘or 
research support should comment on the - 

eben ~adequacy- of- a-criterion.-Whenever-feasible-fr-- SRSA SSS SRE 

. should draw attention to significant aspects 

of performance that the criterion measure — 

does not reflect and to irrelevant factors 

likely to affect HEE. ) Essential. : 
W.. A criterion measure should itself be studied ; x 

for evidence of vaitlity and that evidence ; 

should be presented in the rnanuail or report. 

(E4.). Essential. 


q 
j 
i 
t 
f 


- Table 4. Continued . - - 


—_ Evaluative Criterion ks |” Required Desirable” Ideal. a 
- 7 94-142. 94-142 


“X. The manual or fen aes ‘report should * “x 
provide information on the appropriateness 
of or timits to the generalizability of validity 

; information. (€5.) Very desirable. $ : 
Validity coefficients.are specific to the ‘ x i 
situations. in which they are obtained. If the - 
‘manual is to suggest generalization of validi- . 
ty for prediction ofa given kind of criterion 
construct, it must present date suggesting. 
the limits of generalizability regarding popu: as 
tation or sarnpie characteristics,- situational : 

 . context variables; or variations in criterion 

measurement. (€5.2.1. ) Very desirable. . 

Local collection ot evidence on criterion: . : arte ay x 
related validity’ - is frequently more useful - . : : 

than published data. (E5.2.2.) Desirable. => > a: a 
“AA. The sarnpie employed ina validity study and =X : 

the ‘conditions under which testing is- done : 
shouid be consistent, with recommended test - 
use and shoutd be described sufficiently for 
the reader to judge its pertinence to his/her 
situation. (E6.) Essential. 

BB. Any selective factor determining the compo: : x a 
sition ‘ofthe validity sample should be — we et 
indicated in a manual or research report. The : “os . —_ = 
sarnple should be described in terms of those 
factors thought to affect validity such-as age, 
sex, socioeconomic status, ethnic -origin, 

* residential region, level of education or other 
demographic or psychotagicel characteristics. 
(€6.1) Essential. ; * ; 

cc. Evidence of validity should be obtained for x ~ 
subjects who are ‘of the samme age or in the 
same educational or vocational situation as. ; 

a aa eae the persons for whorn the test ig racormmaend: ada -% Tee. ad 
ed. Any deviation from this requirement | : Ye ody 
Should be described i the. manuai or 
research report. (E6.1.1.) Essential, > _ . 

_ Od. if'a test is used for differential diagnosis, the - x 
manual should include evidence of the test's 

~ ability . to place individuals in diagnostic 
groups rather than merely to separate ; 
diagnosed abnormal cases from the normal - . : . mae 
population. (£8.3.1.) Essential. : . ; 


A 


HH. 


. EE. 


FF. 


Evaluative Criterion 


A. test user should investigate thepossibility 


of bias in tests or .in test items. Whenever 
possible, there should be an investigation of 


possible differences in criterion related 


validity for ethnic, ‘sex, or other subsamples 


_ that can be identified when the test is given, 
The manuai or research report should give. 


the shits for each subsample separately or 
report that no differences were found. {Eg} 
Essential. 


lf the author ‘proposed to interpret scores on 


a test measuring a theoretical: variable (abili- 


Table 4 Continued 


Required Desirable 
94-14 , 


ty, trait, or attitude), hissher proposed inter-- & 


pretation should be fully stated. His/her 
theoretical construct should be distinguished 
trom sinterpretations arising or? the. basis of 
other theories. (E13.) Essenria/. 


A tast manuai or research report should 
‘present ‘evidence of ratiability, including 


astimates of the standard error of measure- 
ment. that oermits the reader to judge 


whether scores are sufficiently dependable 
’ for. the intended’ uses of the test. If the 


necessary avidence has not been coliacted, 
the absence of such information Shouid og 
noted. (Fy ) Essential. 

The procedures* and .sampies used to 


determine ratiabitity coefficients or standard — 


errors of measurement should be described 


' sufficiently to permit a user to judge the 


a. 


applicability of the data reported to the 
individuals or groups with’ which he. is 


concerned. (F2.) Essential. 


{f two ar more forms of a test are published 


of items in the forms should be reported in 


the test manual along with ahe coefficient of 
corretanion among their scores. If necessary - 


information is mot provided, the test manual 
should warn the ceader, against assurning 
equivalence of scores. {F4.) Essential. 
Evidence of internat consistency should be 
reported for any unspeaded test. iF5.) Very 
desirable, 


“for use wirh the same. exarninees, “informa. oe en 
tion on means. variances and characteristics — 


ae 5 


Table 4 Continued 


t 


Evaluative Criterion . ee _.. Required Desirable Ideal. -** 
94.142, 94-142 


KK. The test manual should indicate to what es = 
extent itest scores are: stable, that is, how 7 ; 
nearly constant the scores are likely to.be if a . | eS 

=". parallel form of a test is administered after ; ; 

_time has elapsed. The manuat should also 

- describe the effect of any such variation on = a 

* the usefuiness of the test. The time inte 

to be considered depends on the nature of 
‘the test and on what interpretation of the 
“test scores is recommended. (F6.) Essential. ae ee 


2. In connection with 94. 142° evaluation activities, 
LEA provisions and guidelines should exist to 
insure that test users: > 


Fa 


. A, Have familiarity with Standards for since: Dee, hae 8: 
‘tional: and psychological tests: Washington: ees ; 
American Psvchological . Association, 1974, Pre: , 
B Possess a general knowledge of measurement - X 


principles and of the limitations of test 
inreroretations (Gt) Essential, 


CG. Know and understand the. literature relevant ~ KO yy : 
to the test being used and ‘the testing ee . 
‘problems being Gest with, (G2) Very . : : na 
Desirable. . oe TS ae 
Oo. Have an understanding of psychological or x oy 


= ° + educational measurement and validation and 
_. other test research. (G3.) Essential. 
E. Have sufficient technical knowledge to . X 
‘evaluate’ claims’ made in test manuals. 


(G3.1.1) Very Desitable.. 

“Fi > Base choice of tests or test batteries. on Kos 
clearly formulated goals. ngial. - 

G _ Consider that different hypothe Ss may be x 


Yeas. THIT.2.) Essential > 
H. Are able to relate the history 
. development of the test to it intended use’ 
{H3.): Essential. = 

1. Understand that test scores used for selection x 
or other adrninistrative ‘decisions about 3_ 
child may not be useful for individual or 
program - evaluation _and vice versa. (H5.) 
Desirable. : sO . 

Jo Know how. to translate rest results into x 
instructional strategies. . . 


Table 4 Continued ae 


ee — “Evaluative Criterion Gets a Bin Bek Required Desirable - Ideal 
aa Oe eas a, L 94142 94-142. 


7 = ° S . 


> a 


“Understand potentiai shorteomings of tests <> 
“when used with linguistically. different .# 
. and/or racial and ‘ethnic minority a a eal 


Yom 


“3.0.0 connection , with 94- 142 evaluation, activities, 


at the: ‘LEA level: _ Yas 
AL ‘Provisions are made to insure that those whe x 
. administer. and interpret. tests have been , 
_- trained appropriately for this responsibility. ee 
- BL, -Procedures..are established for periodic) © 9 2. >> 7 - & ‘ 
+. interna review of test use. ‘se ee ae 
CL") Guidelines ‘exist. to insure that rest scoresare |X : 
~ > reported only to peapie who are aualitied a a 


interpret them. ‘ : - : 
{DL Programs. are available ra train assessment _ : St ae Big og a 
Mee ES ane instructional personnel - work? with a ee RE AT 


a children ‘oF. ‘diverse: racial am en back - 
* > “grounds. a . . e So 
" There is "a. reasonable match in. the - * xo 


““districtbuilding between the ethnic-SES 
: student mix and instructional personnel. ; 
Provisions exist to insure that assessment x ; 
‘personnel have? language skitls to cornmuni- {| : ae 

“cate” in the native Yanguage: of any chitl ar a 

* subject to assessrnent. a : 
~ HF sueh> ‘personnel are nor ‘available, formal , soe ae 
provisions exist for securing such personne: s { : : 
“or evaluation services using neighboring, state. * 
. or regional resources; amere vassertion thats * > 
‘ : appropriate evaluation Dersonnel are unavail- 

able is not acceptabie. . ‘ 

H, -Personne! trained in tests and measurements a Xx 
with ° a responsibility to tarry aut validity. 

studies at the local level. and to advise on ». 
“test” Selection; “Use, and interpretatian “are 
> available. ge eS ; 
oe _ +t. Provisions exist for securing consultant 

services in tha abave areas if no district, 
personnel are available for such assignmen 


at es 


“Criteria piesanteds in Table 4 were drawn larcety: from Staniiards for educational — 

and. psychological rests. (Davis, 1974), The. Standards can be easily converted. to” 
hecklists which LEAs can use toa appraise any test considered for. administration Re 

: “in, the district. IP LEA's are serio s about fair test use- then, ‘the Standards must: — 

be. followed; “Or: at. least applied. To be sure, few tests, if any, are constructed 

. well enough to meet all Criteria specified.by the Standards: Nevertheless, careful 


“application of ‘the Standards can lead to improvements in the selection and use oe 
- of. fests. Ce a “ ; , 


ees 


. “Special issues “related to use oF test instruments with minority group persons are 
_ presented in Tabie 5. Reasons for minority group concern about tesy’ ‘use are - 
7 widely: known, cand: have been summarized in a-number of sources. (De: ‘Avita, 

~ 1976; Dent, 1976; Jonés and Wilderson, 1976; MacMillan and: Meyers, 1977; 
“Samuda, 1976: and: Sattler, 1975, to name a few). Details need not be belabored 
> here, but’ it will suffice to note that bias ‘is ‘thought to exist at the content level > 
where ‘decisions are first made: about. what ‘items ‘to include. in-a test (the 
:. perspectives of minority group members are. exctuded), at the level of . 2. 
ve standardization, where » ‘decisions are made ‘about the Population. for. whom ‘the 
© test is appropriate, at the level of administration, in_which tests are administered 
“A by. persons, “unfarnitiar with the patterns of language, behavior and” customs. of the > 
person ‘being examined, and .at the level of validation “where efforts are 
‘undertaken.to determine whether or not the tests’ accornplish what they were. 


designed to accomplish. (Criter: a ppresomed in Table 5 are fs to address: 
these issues, . oe = 3 2. gaoter aa gt 


- There has also been concern about fait test use with: the -handicapped: It was 
~\ noted! for-example (Jones; 297 3)- that, for ‘standardized achievement tests, data. 
on reliability : and validity were rarely, if ever: reported” tor populations of 
" charidicapped persons. Evaluative criteria presented in Table 6, therefore, point to 
_ considerations for assessing: the adequacy of standardized tests proposed for use 
“scwith populations. of neveePeey persons. : . 


>>. 8° There will also he a need, wader 94.142, to conduct evaluations of preschool ca 
chile An.the.present..context,—the. Praphoot chiid-is- defined-as-one- ‘between 
the ages of 3 and 5. Three years of age is the legatly mandated lower age.timit for’ 
7 service under 94-142, Six-is the age at which most children enter: school. For 
“several: reasons, guidelines and. protections fcr school age children are much 
better. ‘formulated thanm-those for “preschool” children. First, there “seems ‘to.be © 
'* Jsome urgency .ta-deal with children already i in school, who must be served now: —- 
* least restrictive environments. provided, Second, involvement in activities for the a 
‘preschool handicapped:is relatively new for special education and most currant . 
= personnel probably. have little: training and backqroure im this area. In any case, - 
it should. not be assumed that guidelines developed for use with school aged 


“TABLE 5 


“ 


FAIR TEST USE WITH MINORIPY 
ROUEN SES POPU. LATIONS. 


°. Evaluative Criterion 4 = ” Desirable — Ideal 
7 od 94-142 - 94-142 


“Examiners are specially trained to work with aay Se & 
“minarity: group/tow SES populations: _ ; ae ae oe. 
A. Have “had coursework and/or workshops 7 > . ) 
_ devoted to the speech, language, social, and 
behavorial: characteristics of diverse minority 
group/low. SES- ‘populations, including that of | 
_the studant being assessed. 
B. Have had supervised experience in assessment’ , 2° 4 | ee 
OF children from diverse minority group/iow ; a 
“Ses. populations including * that of the 
student being asvessed. 


.Y 


2 Examiner expresses conitigence i ‘in ability to fairly : 4 Xx 
» assess the child under consicteration- “t , 


=, Vea we appropriately, trained -dlistrict. assess- * a a 
ment personnel of the sare racialfeathnic/SES : ie 4 
_ makeup as the child being assessed who can’ be ; : 
consulted for assistance | in and review of the 
‘assessment. 


ws . ny 


4. Pravisions -exist for external evatuations if no- uo x 
district personnel are adequately trained to ; 
conduct a fair assessment.i.e.,, meet reauirements 
of 1A, 1B, and @ and 3 above. 


o 


6 For any standardized assessment instrument used... _ . , oO? ens 


*. ithes been determined that _ a > : 
. A. Minority group/ow SES’ perspectives’ on” ? 4 
oe item/task content were taken into account. , 
sete eB Minority “group Now.-SES.--persons- were \——---———~ -- (aba angie Pa ated Sie Mavens Sikes aici 
oS . . invalving in item writing o¢ task selection. : ss 
_ C. Substantial and representative numbers of ‘ a x. 


rhinority -group/iow SES persons .were 
* involved in initial iremndgrk tryouts. : 
0. pBudsrantial ‘and representative members. of oe. 8% x 
“minority group/tow : SES populations. were ° a a a 
included in rest/instrurnent. standardization. : ae 
Itam analysis of items/tasks are available for X 
members of different racial /SES groups. ‘. 
Culturatly specific items have been included. > - 
if appropriate. : : ° 


~ 


“+. Table 5 Continued. 


"Evaluative Criterion : Required. Desirable Ideal 
os ls a 94D © 94-142 ~ 


6. Data on the ethnic/SES ‘wplicability at : : x 
“norms ara @ available. ; ; 


¥ 


“s. Date are pavllteia’ on. ~ ‘ 

A.. Validity as a function of racial | group/Ses . ae i x 

“~) membership. : : ee . aa 
a “°B. Reliability as a function of vata ‘group/SES a x 

» membership. : . ; 
bg 2 
a. 
a> 
. : - 
+ 
ee 
a 


RIC - ia = ¥ 


\NToxt Provided by ERIC iin’ 


1. For 
instructional pia 


TABLE 6 
FAIR TEST USE | 
WITH HANDICAPPED POPULATIONS 


ideal 
* 94-142 


Required Desirable 
94-142 


7 


far “identifying and/or 
mg with specific handicapped -_ . ~ 


each ‘test u 


_populations,. SA's or LEA's will determine that: ; Q 
A. The perspectives of diverse handicapped : ‘ x 
"groups have been. taken into account. in rest ; 
formuilation.. 
4 Be Specific members of handicapped members : 
: are involved in item tryouts, . y 
"-C. Substantial and representative populations of | : x* 
Specific handicapped persons are Inyolved in 
“+ test standardization. ; ; 
P _0: When,eppropriate norms are available. for. ss x 
specific populations of handicapped persons 
in the 3-21 age canga. ae 
_E. Vatidity” data are available for specific ; . ; x 
populations of handicapped persons at ; 
specific age ranges. - ; : 
'F. Reliability data are available for specific™ ‘ . “yk 
- populations of handicapped persons at + , se 
. specific age ranges. ‘ 
2. SEQ or LEA personnel will be availatie to: : “~ , 
A. sult On appropriate test use with specific ~ . ®& 
populations of handicapped persons. - ~ oS 
" B. Conduct research and development activities , x 


in the modification and/or construction of” 
tests for use with specitic oopulations af 


handicapped persons in the 3 - 21 age range. , . 
iM Lo 7 hadsies 
r x 
: : 
45 4 
‘Su 


-shildren: apply, ipso facto, to preschool ones. Many guidelines do apply and > 
, there: is: ‘much ‘commonality in quidetines:-for the two populations. For example, — - 
criteria “tor the selection of evaluation instruments, procedures for obtaining 
“informed © consent, cand due ‘process considerations apply to: evaluation of 
~ preschool children as well as tq school age ones. There are, however, several 
_additional considerations, that apply . uniqudly to evaluation ‘of preschool — 
populations and these need. to be ‘brought’ to the. attention of evaluation 
; - practitioners and consumers if adequate protections are. to be @ developed. These 
: _ points. are summarized in Table 7. ; : 


. 


; aap the ala oa tae a tests and other evaluation materials are to be 
provided and administered in the child’s native language’ or other mode of 
communication, unless it is clearly not feasible to do so. The position taken. in 
this paper. is that -there ‘should be no conditions under which appropriate | 
evaluation is infeasible; LEA’s must make provisions for appropriate evaluation. 
Several criteria (items 3A, 3C, 3D, 3E, 3F, 3G) in Table 4, Test. Evaluation and 
Use, are related directly to this question. The critical item is 3G which states 
that, LEA’ s must make provisions for either- ssecuring appropriate personne} to 
conduct assessment in the home or neighboring district, or elsewhere. In the | 
latter instance, adequate protection. may require that assessments involving rare 
and/or difficult problems, or those involving: children having | “‘unusua! ee 
backgrounds, “be done at stat@, regional, or national centers. The development of, 
such centers, obviousiy. will require appropriate efforts at LEA, SEA, and 
national: levels. yy 


. 


ASSESSING PLANNING AND PLACEMENT. ~ > 
TEAM ADEQUACY AND FUNCTIONING — 


Background. . _ - 


The Regulations require that 94-142 related evaluation’ he “made by a 

- multidisciplinary team -or group of persons, inciuding at least one teacher or _ 
other specialist with knowledge of the area of suspected disability.” Placement ; 

ot Prncraures. regulations. require that the decision is to be. made. by..t’a groun: Oka. Cite tat ale eae 
“persons, including persons knowledgeable about the child, the meaning af the 

7 evaluation data, and me pisceraent options.” 


Expieie in both gagiiadion and placement procedures, then,.is the.requirement 

that a team of individuals will be involved in deliberations-about the child and - 

his/her educational placement. While there will be variation in team composition 
aS a function of the issues at hand, the tearm is exnected to be muitidisciplinary, 


EARLY DEVELOPMENTAL ASSESSMENT 


Evaluative Criterian . . | Required Desirable — Ideal 
94-142 


a ‘Early screening ig limited to: aa 
A. These measures of organic tunctianing and os | _& 
4 basic, adaptive coping skills which enjoy a — : : 
high degree of cansensus. wishin the health. 
professions and affected: cornmunities.- - : 
B. Those behavioral factors especially associated eee. 
_with learning language and speech. deveiop- 
“ment, moror skills and perceptual abilities,” 


. 2. Specific assessment ot emotional and behavioral ee x 
adjustment and darentichid interaction are Jett ; 
to Parenta! initiative. sd oe oe 
3. The early: developmental review | : fos ie << 
© K “Does*nar attach a labet or categorize a chi! te 
"prior to. extensive study and analy sis. “ 
BL Makes’ a dedicated effort to engage the 
primary caregiver, the Darent.as a collabara- 

_ tor in: the review process, and attempts to > 
insure’ that the interpretation of the findings 
of the developmenzal review aro culturally: 
reievant, as deli 83 vsychologicatly: sound. 

C. Recognize that there isnot, at the present . x 
tire, a single, universaily acceptable tool fer . pT ee 
developmental raview, while at the same time . ° 

«. pointing Out that there area multiplicity of 
such insteurnants that may Rave practical 
cutitity,, in diftaring situations. oriented toward 
‘reviniw ‘Of indivieual and specitied agvelons 

“rental Or a, 


x ¢ 


Developmental review in the early periodic screening. diagnosis and treatinent 
program, Washington U. S. Defartment of Health, Education, and Welfare, 
Health Care Financing Administration, the Medicaic! Bureau, April 1977, 


rote Source: American “Association of Psychiatric” Servicas™ for Chitdren ner 


to: include regular and/or special acuication teachers,. and to include specialists 
knowledgeable about the student's actual or perceived problem(s). Parents, 
_ parent surrogates, or: advocates: ‘must be included as well. By whatever name (e.g. 
planning ‘team, planning and placement teams, assessment: team, placement — 
committee; evaluation. and plaéement: committee, educational assessment Service, 
- school appraisal ‘team, etc.) a multidisciplinary team is central to what is to be 
done, how it isto be done, and how the information gathered is to be used. 


7” “Evaluative Criteria 

Criteria for appraising ‘the effectiveness of PPT: eae and functioning are 
presented in Table 8. The first evaluative item ‘concerns the development of a 
framework for Planning and placement activities. Such a framework would show : 
_ the relationship of team activities to the LEA's instructional program, and would 
be organized internally to effectively discharge its mission, 


' Ideally, a priooaty of PPT activities ee should be available in 
written form, the. thrust of evaluative criteria 1-8. Other quidelines relate to 
‘ composition of PPT committees, specific PPT activities. and PPT accountability. - 
The tarter guidelines refer to such activities as insuring that a responsible LEA — 
person be given formal authority and responsibility for monitoring PPT 
activities, that vehicles are developed to monitor PPT recommendations, that a 
written agenda be developed for each PPT meeting, and that there be a written 
report of the meeting's activities, analyses, conclusions,“and recommendations. 
Information relevant. to establishing accountability in the assessmment- PCS MEE 
Preeere $ presented in Table Q. 


Discussion 


The -buiiding of protecti ons to insure that planni ng teams work effactively can, 
procead from actual knowledge of how teams operate in practice, and: how they 
might operate, ideally, to discharge their missions. The most impressive and 


"= coherent’set-of anatyses-and’ findings: related to blanning team activities is to be 


found in the work of. Fenton et al. (no date), Fenton, Yoshida, Maxwell and 
Kaufman (no date (a)), Fenton, Yoshida, Maxwell, and Kaufman, (no date (b)), - 
Yoshida, Fenton, and Kaufman (1977), Yoshida and Gottliev (1977}, Yoshida, 

Fenton: Maxwell, and augman (no date (a)), Yoshida, Fenton; Maxwell, and 
. Kaufman, (no date (b)) and Yoshida, Fenton, Maxwell, and Kaufman (no date 

(c)). The results of research by these authors can torm a background for building 
protections to insure adequate functioning of placement and planning tears. {Itr- 
might seem, sinoe the research was limited to only a single state, i) ira 
: should: be treated with a coe of eayson, However, since the pro¢éesses and 


TABLES 


“ASSESSING PLANNING | 
*-- AND PLACEMENT TEAM(PPT) — . 


ADEQUACY AND FUNCTIONING = on 
Evaluative Criterion | ~~ Required Desirable ideal 
94-142 Ss Ob 142 


“VL Planning and placement rear (PPT) activities are 
developed from 3 rational framework. 


2, At .the “district level, guidelines exist for the x 
Son MNunOE of PPT's. : 


, 3. At the district level, written guidelines ¢ exist for x 
the conduct at PPT activities. 


» 4. At. the district level, guidelines exist: for _ x 


contacting PPT participants, : St 
5. PPT membership include the fottowing: : 
A. .A representative of the ‘public agency, ¥ 3 
twalified to provide. or supervite * the 
provision of, soecial education. oo : : : : 
B. The child's teacher » 3 ee ee 
©. One or both of the child's narents or 2. om ye 
a) : : . 
a - ‘Surrogates : 
D. > Tha child, where appropriate f ” oe 
E, Other individuals at the discration of the 2 ‘ : 
parents or agency a 
1, Parent advocates — * — SX : 
. 2 Community advocates : i XK 
F. Evaluation personnel . x 
*6. There are district provisions to insure that PPT "x oes 
in ee are Satonmed’ about t the team ’s legally 
os “assigns ee skeet 
“7. Procedures are developed -to insure that/ PPT - : x 
mernbers agree on tear goals. 
8. Written guidelines for PPT activities exist. 4 : x 
= ~~ 
9. A written agenda to accompany each PB ; xX 
meeting is available, : * Sate 
. e 
T'YO. PPT members are given access to all information ° a & 


that bears on the cate. 


AG 


Sot 


* Evaluative Criterion 


* V1. There is a:single person in the district with the 
; ‘authority and responsibility for insuring that all” 
: S pertinent to" a given case is made 
: “available: to-PPT’s. 


12. PPT's .8re given access directly’ to persons. having 
= information baaring on a given case, or: reports 
_ from suen. persons are provided. in. written 1 form, 
“Al oral presentations before PPT’s are ‘summa- 
: : rized for the record. ~ 
_ 330 Ges sabes are developed: to insure. equal status 
(non-specialized) participation among PPT. mem: 
bers i in all aspects of PPT activities. 


14. -For each case the potential contribution ‘of 
Specialists from each groun listed will be forrkally 
considered and either tormatiy requested or 
formally rejected as unnecessary - 

.* School administration . 

Special education administrator 
Physician 
Parents 
School psychoiggists 
School social workers 
Student : ; 
Referring teacher 
Receiving teacher 
Educationai diagnostician 
Speech pathologist 
Physicai therapist 
Occupational therapist: 
Audioiogist 
* Schago! nurse 
“Guidance: counselor | eee 
Curriculum specialist 
- Methods and materials soecialist 
‘Opthamologist/opromerrist 
Vocational rehabilitation counselor 
Other specialists : 


“we . . 


7MOOB» 


peta AE 


c 


PPT’s make certain that the child is assessed in all” 


areas related to the suspected disability including 
. where appropriate: 
> AL Haalrh 


x 
x 
x 
_x 
x 
x 

_ x 
- 
x 
x 
x 
x 
os 
x, 

Ms 
x 
x 
KX, 
x 


Table 8 Continued 


Evaluative Criterion : Recuied. Desirable _ Ideal” 
_ 4: 1424. 94: 142 ; cole 


ig 8. Vision 4a ah xo 
C. > Hearing =~ f x. 
DB. Sociat and emotional status. x 
_&. General intelligence x 
F. Academic performance xX 
G. Cormmunicative status x 
H. Motor abilities x 
16. PPT's determine -whether ‘sufficient types of x os 
information about the student are available to it 
_ before making” @ decision affecting the student’ 5 
, instructional program, ~e : : 
/ . y 
17. PPT's evaluate the educational Tigrticance of the ex : : 
, data. 74 : 
18. PPT's deterrine the student's eligibility for e : ‘s 
special education. as as - 
. 19. PPT'S determine student placement -  & , 
. : . te ae . E ’ aS ‘ 7 
re 20. PPT's formulate appropriate year-long education- 4 
— al goals and objectives for the student, 
‘21, PRT's develop specific short-reillMnstructional == X 
" _ Objectives id the student. oe 
” : ‘ < 
; 3 
‘22. PPT's formally communicate with’ Darents- -about x ‘ 
changes in the student's educational Program and ; 
nite response, 2 ° res oe: 
5, * a ” = : : 
: 2. PPT’s formatly communicate with the, building xX 7 
administration abour changes in the student's © er ~~ 
_... educational program. and invite response. de Gein Pee cate aeRO AGC. Fatah MURS MORAG mae ete aaa 
24, PPT’s formfily. cc communicate with the teacher(s} = xX 
" about changes in the student’s educationai . 
" program and invite response, ‘ 
" "26. PPT’s plan ‘information needed for future review “, * x . 


of the student's program and progress. , 


- 26. PPT's make certain that each recommendation is : 
a @companied by: ; 
A. A time-ling for execution x 


: A a 
: 51 wy 


Table 8 Continued 


“Required Desirable” 


94-142 
BIA staternent of means by which adequacy of _ = X 
: ’ execution will be determined yo ae ~ 
oo CoS The specific person(s) responsible far execu- x . . 
* = s 
tion sas rhe recommendations. , a ‘ : 


27. PPT's will review the continued sopropriateness x 
of the student’ S educational firagram. ; a 

: Sen 

. PPTs will review _the dugaaes educational XX 
progress: 

_ Awwrtitten report af aati PPT meeting wait be =X 
made. : 

» Distrigts insure that guidelines extst for providing ~ 
feedback ta. PPT participants and. program 

implementors. : : 


. There is available in the schoo! distric! a single 
person. with authority and respansibility for 
wertitying that district guidelines with respect to 
PT activities have beer foHowed, and PPT . 
recommendatiors carried out. 


* 


and c]. See References far full citations. 


: 


mtn ettehenttens enti sssnteans aease eR Seemttem Sos Fm 8 eee Se naam Fe ert oe 


a 


Idea! 
94.142 


Sources; Fenton, et al. (no date); Fenton, Yoshida, Maxwell, and Kaufman, {no _ 
date, {a)] Fenton, Yoshida, Maxwell, and Kaufman, {no date. (b)} National . 
Association of State Directors of Speciai Education, 1976 (a): Yoshida, Fenton,; , 
and Kaufman,. 1977; Yoshida, Fenton,’ Maxwell, and. Kaulnan {no date, a. b, 


TABLES Coat, te 
ACCOUNTABILITY IN THE * . 
ASSESSMENT —PLACEMENT PROCESS 


4 


Evaluative Criterion ‘ | Required Desirable * Ideal 


\ 


Sai bat 94-142 


r 


: : ho ‘insure. that 94. 142 related evaluation: fassess- © 
‘ment/aporaisal activities are: 

A. Relevant to educational needs 

1. contain specific pragrammina implica: 


Wy we stlons ~ 
2. cantain suggestions for specie strate- 
gies. : 
a BL Pedagogicatly sound . 


C. Appropriate to- the decisions to de,made | 
D. Written in simple language- 2s : 
1. descrihe performances in’ descriptive 7 
~ terrns 3 
"2. use nontechnical terms 


above. at not be particinants -in. ave 
_asnessment. programming activities _ im the fase oes 
- under consideration, At the SEA lavei quidelinas , Se a ‘2 
exist to audit and mofitor 94-142 evaluatian 
~ related activities. . . 


wv 
3, Formal. LEA” provisions sxist. for securing a x 
, _beprasal oF Participant involvement in and 
‘ reaction ta the assessment-placement process. . - oc oa 
A. Parents ° a ; pre > Phe a, 
"1, Reagtions ta “Their own involwgmner:t °°. ote ; x : 
. degree of participation, ard mbeting : 
7 dynamics are obtained , 36" : 
* : 2. Degree of satisfaction with + outcome i$ : x , 
deterriined (with fotlow OR. as appronri- 3 
ate) . : = - “ 7 
4 A Benctoad: ta their awn involvement, : MK. . 3 
. degree of participation, . and meeting ao SS ms 
a tg dynamics are obtained. : ; . 
. ¢.. Degree of satisfaction with outcome is x 
determined {with followup ¢ as approur: = : 
ate), ‘ . 


Source {item 2 above): National “Association of State Directors. of Special 

Education. Functions of the placement committee in special. education. 

Washington: Mational Association of State Directors of Special Education, 1976. 
x 


* cn 3 é . * i 


s 


procedures “described as. operitional in Connecticut: appear to be very much 
_ characteristic: of the: placement and planning” activities of” many LEA's, the - 
, cesults probably | have wide. fe generalizability). _ 


me 


> Data ‘aon the eres -program on “PPT functioning. cited above. have been 

: > Seewn on “heavily. to develop: criteria which, if operationalized, can-be helpful in. 

ee improving as well as monitoring PPT activities. For example, Yoshida, Fenton, 

_ Maxwell, and Kaufman (No date, - be found ‘that’ program: implementers, 

especially regular teachers often were not present at PPT meetings. They found . 

is ' Yalso that. there was not uniformity: in communicating PPT information. Among: 

ae “groups: receiving» -PPT. information, e.g. regular teacher, special . education | 

, teachers,, and. support personnel, no ‘group’ received written’ information. with 

consistency,. and at best only 59% of one group of program ‘implementers, 

_ {special education teachers) received written and/or ora] communications from - 

-PPT's; other program, implementers received written communications even less. bo ae 
Senet Yoshida, Fenton, Maxwell, cand Kaufman (no date (b)) note that. « 

“enost > information, except. for’ that communicated to the. special education _ . 

ae was communicated. “orally; documentation in the form” of written, 7 ee 

. communications was. produced Yess” often.” Yéshida and his associates go on to é ae 

- suggest that “one possible method for. reducing the. ‘informality -of - the oe eee 

communication network is toiprovide’ ‘the ‘program implementer with written i. 
docurnentations of the PT decisions and the file of information which was used’ 
to arrive at these decisions, Another method ‘is to assign one PT member the 
responsibility ‘for . “communicating. with all program implementers, thereby 
> reducing not only the number. of different messages. that will be transmitted but: 
also the time ‘ommitments of PT members: for coramunicating the PT decisions” 

. 10). Finally, the authors note that ““"Regardiess of. the method used, PT's 

inst: develop, procedures. for verifying that the PT decisions and the. student’ $ 

Ws program ‘are transmitted without distortion in order to insure that the decisions 

arrived at with the, consent. of parents. are. the ones implemented” (p:.10). . 

- Research based observations such as those above were the basis of such Table 8 _ ; 

evaluative criteria as items 22. 24, 26, and 29 ~ 31 . oe 


- iy 
‘ . : Pan 


- Fenton, Yoshida, Maxwell, ‘and Kaufman (no date,. (b}) found that "(a) not all 
3 PT's have an.accurate idea about the scope of PT activities, and {b) that PT. 
—“"—" emibers recognized” duties differently according to their roles; specifically more——~ yee 
= a administrators and. support personnel recognize the official PT duties thando —~ a 
requiar education teachers" (p. 8). In yet another study. Yoshida, et al. (no date, ~ 
a) found a strong. positive relationship between staff role and participation in the : 3 
PPT process, especially for. regular and 5 cial. teachers ‘and school’ psychologists, 
in which school psy cholagists perceived themselves as high status and high 
particfants. whereas teachers perceived. “themselves as low in status and 
participation. The results trom this latter study were the- basis for Table 8 
evaluative itemssuch as13.: 0. —_ ; 

a 


we 


e:-reséarch “cited ‘Gna’ the. examples given are. meant = he be be illustrative. of 
~ possibilities for-usihg research results to build. criteria which: permig. an ‘evaluation me 
. of the effectiveness. ‘of PPT functioning: within the 94-142. Context, and also to, 

> guide LEA's in structuring ia activities. : 


% When PPTs junction inaltiahenty. oe ahaa: all PPT members do not participate < 
‘fully, “errors. of commission probably. result. That: ‘is, ‘to: ‘the extent that. few ; 

7 specialists Participate, and: hence bring. only: limited perspectives to bear on r any: ' 
_ given Case, the probability a erroneous classification i$ increased. 


; Many’ criteria fer idsel pet functioning have, ‘been presented, ‘Meeting’ shar’ will 
oe “pose a great. challenge. For: example, there.i AS) NO» -gainsaying that developing 
* “methods ‘to assure equal- status participation: among a‘group comprised both of 
rofessionals and _non-proféssionals {i.e, parents): will be difficult. By putting * 
_ forward the’ requirement of equal- ‘status participation among: PPT. participants’ as 
a desirable PPT outcome: (and other ideal: Zed criteria)..it is to be’ hoped that ©... 
See research and programmatic activities will be stimulated to’ ‘accomplish’ this as. well. 
; as. other: desirable objectives, “and that. 94. 142 implementation. will be the better 
i because of these efforts. ce 


or ey : OS, aed 


as 


7 Folloyep x ape 


a A program ‘of. tallow up woul sdemn << have thieke comoonents: a A timetable. is 
of activities, which was: developed: ‘by. the’ planning: téam as partof'the TEP: (2)-as: 
i “nearly as: possible ‘originat ‘PRT members, but in. any Case, the parents, and: the 
7 child's requier and/or, “special teachers; (3) a set of guidelines: which direct’ 
2) fotlow-u uD team, cornposition and functioning: ‘and (4) an. BEAL -bérson responsible 
for certi ifying teat’ ali LEA guidelines for Follow: 0 activities were met Details of 
, fotlow- up dimensions may be found i in 1 Tables 2-9. 
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The. best” protection’ “in “evaluation ‘procedures is to adequately t train personnel. 2 ~ 
Clearly, the definition | of. protection in - evaluation procedures. should. be core 
interpreted to, mean evaluation by’ ‘persons, Competent to engage in testing/assess- 
: ment activities, to fesponsibly ‘interpret the. resuits, and to adequately: plan 

instructional activities. ‘based ‘on evaluation and other data: Guidelines and check — 
> lists relating to :94-142° evaluation activities; whyle useful ‘palliatives, will not 
solve: the “basic: ae fundamental PIDs in personnel prep aerGn at now 


-Randicapped children in-schools, must ‘come ‘through legislative ‘changes at. SEA | 
levels. and probably from a national effort. as'well. For example, the requirement _ 
. that children be- educated. in east restrictive environments also obligates colleges» 
and universities, and state credentialing agencies, to adequately. train personnel . 
for “such. “work. ‘Coursework: and/or. “competencies for work ‘with exceptional” 
children ‘should be: required of candidates seeking regular. teaching credentials.1n 
“one large state having a ‘gompetency ‘based program for “gredentialing. regular’ 
“ teachers, and otherwise gearing up to meet 94-142. requirements, ” ‘no: competen- 
> cles® ‘are yet mandated that deat “with knowledge ‘or. ‘experience with mildly » 
“ handicapped: learners”: for regular class: teachers” (MacMillan, Jones, ‘Meyers, 
ors. p..7). Course work and/or experiences, and competencies for work: with 
ee ethnic minority groups similarly have not ‘yet enjoyed widespread: ‘adoption. . 
me Moreover, many teachers. do’ ‘Rot possess knowledge of principles ‘of tests aad. 


results, particulary in instructional planning. ‘Indeed, an . early - - study 
(Goshn, 1967) reveatedt that less than 40 percent of. ‘teachers: surveyed in a. 
“nationwide ‘study. had had more than minimal exposure. (one. course) to training © 
> in test and measurement techniques. A sizable Droportion of teachers, had never 
had evena single course in measurement techniques orattended a clinic at which 


. teachers in® particular report a_iack of _exposure to: formal ‘instruction in 
measurement with. mare than half of those who reported... » indicating: that. they» 
had never, had any ‘special ‘raining’: (Gostin, 1967. 0. 127). It Is possible, of 
. course, that principles of test. use were acquired informally. However, no | 
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The depth of ‘teacher misunderstariiing of tests and ‘test use 1$- great. ‘Goslin. 
11967) reports, "for axampie that ty teachers tend to view standardized tests as 


“ments. a fact which. may be true ~-For some students, but ‘surely must be- 
- questioned . others: that (2) teachers see the kinds of activities measured by 
standard: zed test ts” aS. import ant determinants of such ; academic: success. at 
chiidren,: ae to a lesser extent, of their success in life after school; and (3) that 
teachers. pelieve that 
with “Other measures such as school grades, in making decisions about allocating 
pupils to apecial | classes, tacommending ‘students for college admission, _and the 


: accuracy. of standardized. tests also feel that they measure the qualities necessary 


- the abibties measured are, to a significant degree innate, rather than learned. 
"Further, they, tend to foot that considerable weight should, be given to-test scores: 
in making dacisions. about pupils. Teacher opinions of test use for instragtional 
planning | "was not reported ed Gostin but, obviously: systematic exploration of 


aw 


exist. “Pheie: robles: which: concern: ‘the ade, of eating: stor ‘work: with 


‘measurement. Such background,*is essential. to. the proper use ‘of tests and, test 


st eee 


‘testing was discussed. Moreover, . . “elementary and private secondary ‘schoot as 
evidence’ was presented on this point, and one doubts that a was in fact the ; 
relatively accurate measures of a.student’s intellectual potential and achteve- < 
econsiderable wei ight should ‘be given’ ‘to test ‘scores, ‘along | ee 


like. “Finally, id) Gastin found that teachers who. express “gonfidence T rs 


“for future academic and nonacademic pursuits. These: teachers aiso believe that 


Ae 


such pa would be valuable as well, 


The: extent to ahh formal and up-to-date training in ‘tests and. measurements. 
: ~ would modify. views expressed by Goslin’s respondents, is of course, unknown, 
" It.will suffice to note that many regular teachers appear ‘unknowledgeable about ay 
~ testing and assessment matters, an understanding of which seems necessary for os 7 oe 
> bee oiam protections in evaluation, and to implementation of other. siaiieh of —- 
94 142. 


~ Questions need to be ae about the training of seyesenana {and other 
: personnel intimately involved in 94-142 evaluation activities): who. often are key 
>. persons.in- planning and placement activities. Some states require no certification 
‘of school psychologists at all. In these states it would be difficult to insure that , 
: psychologists have adequate ‘backgrounds for their work. in ‘most states. schoo! 
psychologists are credentialed; some credentials are competency based. In 
California, as. in other states there is no requirement that the school ‘psychologist 
have. teaching experience, although competencies are mandated which require 
. familiarity with instructional programming. ‘And even in states where teaching ; 7 
experience is prerequisite to school psychology certification, there is not the eo 
further requirement that: the experience be with the population. on whom ° | 7 ee 
_“ asseeaments are to be madé. Thus a. psychologist. may have had all his/her as 
teaching experience at the high school level, yet be “engaged primarily. in SS 

“educational programming with elementary: schoo! children. 


Bucchiheniiste bring a number of skills tothe assessment and placernent process. 
‘They often have special expertise in behavior ‘Management, in interviewing and: 
in matters of classroom climate. However, since a. major focus of activity under - 
94-142 will be upon the use of tests and other evaluation procedures to- pian © 
- incividuatized educational programs, it is important that atten be given to: 
_ the ‘professional qualifications of persons | (psychologists: and others) who. 
“prescribe or deliver evaluation services. ‘State credentialing cequirements will 
need to. be reviewed carefully to determine. ‘the. adequacy of provisions: for 
personnel preparation to engage in such activities.. 


To summarize, it has ‘been Luggested that protections in evaluation seoceduied? 
require personnel . adequately trained to use assessment procedures. for instruc- .- 
. tional planning, and other related purposes. Available evidence suggests that 
Sox ss! _many_regular_teachers.(and-other.personnel). may nat-be- adequately-prepared-for-—--- ~~ 
94-142 evaluation-retated activities. It has been speculated that the deficiency 
_ May, reside in SEA credentialing requirements which do not adequately mandate 
competencies to carry out 94-142 evaluation requirements: The extent to which 
_ this is in fact the tase needs to be ‘carefully investigated. if found | to be true, 
; appropriate corrective steps must be taken. 
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Special Education Theory, 4 


and: TEP Development - : = - 4 


Testing arid assessment results are closely tied to IEP development. First, the 


_fesults of tests and measures are used in part, to.indicate that an educational 
problem does in fact exist. Second, test results may: be used to pinpoint. areas . 


presumed to require remediation. Third; tests will be used to determine whether 
the intervention activities have been successful. In order to be of value in this 


~test-intervene retest process, assessment instruments must be sound. For | 
example, a test must be reliable. Reliability is related to a test’s validity“in that 
the validity coefficient cannot exceed the square root of its reliability 


(Cronbach, 1970). Similarly, tests must not be racially, culturally, or linguistical- 


tly discriminatory,. requirements which are at the heart of 94-142 protection in - 


“evaluation procedures. Criteria for assessing the degree to which tests meet 
appropriate standards of acceptability’ for use with linquistically, culturally, and 


exceptionally different persons have already. beén presented in ‘Table 5 and 6. - 
While problems of adequacy nexist, they are grobably solvable, even using 


presently available psychometric technologies. 


a 


'. Itumay be possible to develop tests and measures which, while not racially or 


culturally discriminatory, do hot predict any educationally meaningful perfor- 
mance, or provide information which facilitates the evelopment of instructional 
activities. Thus, even when appropriate bias- free testé are developed, we may still 
be: faced with more serious’ problems of ia) the absence of established 


“relationships between the attributes measured and-school - performance, {b) and | 
the absence of a theory (theories) of ‘teaching: learning in specie! education. The 


two wos are, of.courte. closely interrelated. 


In.commenting on the first sia (a spate): Orasanu, MeDermitt, and Boykin 
(1977) remind us that 


. in“orcter for a test to be useful in the, description af what a chile knows 
relative to what is to be learned, the test must offer well defined tasks which - 

_ af@ essential components of what must ba done in the performance of some 

cotnplex: skilted “behavior, such as reading. That is, we cannot give a child’a 

reading test -until-we can show that the iterns on the test are well defined, in 

the tett taker’s eyes and that they relate to the skill we are trying to teach. 


skill is available. Adequate task analysis describes what a person must do in 
order to perform successfully on the final task, @ g.. fead and comprehend a 
page of text: furthermore, it must identify sub@kills so that tetts can be 
constructed which with monitar a chk progress on these ‘campanents, 
(Orasanu, McDermott, and Boykin, 1977). 


In using tests for IEP development it is assumed. that we possess valid 


j information about the growin and development of academic and social abilities 


nea 


# 


“This requirament Dresumes that a complete and adequate analysis Of the targer 


_awhich such growth and development takes place, about: the. upper level of - 
growth for various kinds of achievement for different populations of handi- 
_ Gapped (or indeed non-handicapped) children, and that existing tests. and 
4 measures are. developed well enough to be. sensitive to any ghanges that might i in’ 
. . fact occur, (Jones, Gottlieb,.Guskin, Yoshida, 1978): Regrettably, we cannot say 
ce ; with any certainty how much growth can be exnected to-occur in students with | 


can’ we be certain that very many existing measurement. instruments are 
; developed well enough to enable us. to confidently measure pupil gains in 
a hievernent, a critical requirement for evaluating 1EP effectiveness. 


Moreover, Morrisey and Sater r(ng7n ae that 


ey 


. to measure program /HEP" s effectiveness in terms of pupil change: indicators 
lea. achievement) it would be necessary to confirm that what was prescribed : 
was implemented, and that the variance that was observed/measured could be :. 
accounted ‘for inzterms of ‘implernentation. This ‘would be a particularly 
difficult charge since IEP related activities will have varying correspondence to 
etements of the prescribed educational plan and take up varying amounts af 
the instructional day. These problems, coupled with the inherent difficulties in’ 
pre-test /post-test methods of measuring/recording pupil ‘performances, suggest 

_ that it may. be methodologically difficult to assess-IEP effectiveness in this 
way. Moreover, the precision and.fraquency of documentation that would be < 
requirect. to collect reliable data. make use of such methads prohibitive. 

a Therefore it may be most desirable to consider multiple and varied methods of: 

effectiveness — cost, resources. satisfaction anc pupi! measures, At any rate, — 
determining appropriate measures of effectiveness will be an initial difficult 
task... {pp. 35-36.) 


Theory. is critical to the development-of instructional activities, and it is to be 
regretted that so jittle theory of the teaching-learning process in special 
education is available. While all manner of tests have been used to predict various 
special education outcomes, only rarely has the selection of measures been 
quided by theoretical models or considerations which generate the basis for their 
selection, which predict various special education outcomes, or which expiain 
how they function singly, or in sang to lead to some specified educational 
- | accomplishment (Jones, 1978}. is q It-to see how tests and other 
“evaluation procedures can be He otfedl ly in developing tEP’s in the absence 
_ofs such knowledge. _ - ° 


In the context of their. discussion of competency based teacher education in 
special education, Semmet, Semmels and*Morrisey (1976) stated the need for 
theory quite well. They noted that : ‘ 


. Theoratical conceptions must yeek to identify those instructional and 
: pupil characteristics which most probably relate to pupil growth, This impties 
F mare than the construction of hypotheses related to the effects of one type of 


59 


of special populations, ‘that we baat something: about the conditions a 


{ 


“various learning and/or behavioral profiles taught by method A ofy method B, nor giro 


ae 


tt eu ‘be noted, 


8 a = 


construct models which suggest that teachers with specified characteristics, 
who demonstrate specified | observable teacher behaviors, with pupils having 


Specified learning characteristics Will produce desired pupil outcomes within 


the limits of specified educational contexts. The complexity of searching for 


“{Semmel et et al. 4976), pp. 200.201. 


” Sdninistrative arrangement over another. What is needed are eisoes to. 


“functional relationshins-between presege, process, and Droduct variables in the-- 
| study of teacher behavior demands ‘a’: ‘sizable effort. . .. Theory is a powerful 
-tool for organizing such an endeavor. It is, to be sure, snot the only promising 

strategy for. uncovering ‘meaningful relationships between teacher behavior.and 
~ pupil growth. But it is, in cur apinion, a necéssary component of a total . 
astiothes 


in summary, ‘that adequate protection in. ‘evaluation 
procedures should ‘refer as much to insurance that any tests and assessment 
“procedure be valid for the development and assessment of instruction as to the 
requirements that. they -be free of racial, ethnic and SES bias. With so much. 
justifiable concern about the facial/ethnic bias of tests, too little attention has . 
been’ given to the tests’ educational validity. Obviously. if evaluation procedures 
are to be validly effective for use in. the devaloperent of 1EP’s, NS) ‘theoretical 
and research work will have to be done. 
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“ay trained sersonmel in 


tests ant! evaluation materials be administered! 
nformance with the in stFUCTIONS provided: by their Droducer.” 


e. « 2. Multidiscipiinary Placement Conferences. The legislation and the rules and 
a ; , regulations make the. assumption that wicier representation in the placemant- 
a dlanning conference is dike! y to reduce misctassificati an. Far example, Senate 
Report No. 94-168 stat es: “The Camimitteg has designed: the -individualizedt 
clanning conferences as one method! to prevent tabeling orm! sctassif ‘cation. 
the Federal Register | tre rulas and regulations: stipulate’ that mgcemen 
™ procedures shouid “SAsure, that the Olacement decision is made hy @ group at 


ye 


In 


~ persans, bees persans knowledgeable about the child, the rmnganing of the . 

: avaiuatian data, and the placement options.” They do not go so°far ag to 

; recommend that a parsntor acarmmunity- advocate be included in the ohacemens 

ge conference. However, the possibility af inciuding Sereeae! persons is irnplied-in 

: "the phrase “persons RPO nietaneui about the child " Relat ed to this requires 

. _ ofoant isthe provision that “the evaluation is made Gy # mu hidisciptinary hace 
oe grauo of persens, Including 
-. knowindge ia the area of suse 

any S 

a caning 135 

£ sae 

oO arg to be inciodad im the 

meng fenvmm * ~ ~ ~ 


WO DVO PUVDOSS! 


handicapping condition anc assessing edlucatianai nects, 


ee We oe 


physically nancicapning cond itionms amd chile trac who ara 


for “bilingual,” 


a ee Qa. . . : 
“ERIC ce ree . * 


ee 


a) 


“The Medical Mode 


Pot 


emen fonai status, genera! intelligence, academic performance, commiu- 
SLE T US, meter abilities’ and “psychalagical, -physicat, and adaptive 
Jecammendations, ‘physical coneition, social or 
behavior.’ , 
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8 language or. mode of cornmunication. 
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CHAPTER 2: ASSESSMENT MODELS 
UNDERLYING THE REQUIREMENTS, 
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antis to be multidimensional. It is to cover “health, visionz hearing, 


ces of information are to include “aptitude and 


Nase assessment’ 


Tee 


sand combat pathological Gonditions in the erganism, 
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Questions Aildressed ay the-Madel, : : 
Th medical modai is designed to answer questions about the state of “the 
“organism. Hence, the measures of “health, vision, hearing : . . arid: motor, 

abilities” (Feclera! Re ene eee (3; {F!} ane of “physical conditian® 

(Federal. Register 3. 4.5233} Al PTiT}) mandated by. Public Law Q4-142 will. 


» require avaiuators to utlize the medical assessment model 


: : — 
desi nition oe Norma Abnormal, — 
An abnormality in the orgahism is defiled a3 a process that tends to destroy th 
“biaiog ogica int tagrity: of the orgar nism as a Hiving system and to interfere with “ 
ngs processes aresiden a you % 
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7 The above stateme % does fot mean hat there i is mo correlad or: betwaen<aci val. 
and - -cultarai charact ristics and some biological pathologies, For.ewa die, sick!é | ; 
; nemia is more: common’ amen nee: Americans and . Tay: Sachs - sease” as 
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are oe “The. high: . 
2 ach: group p is related to cleariv Heng ‘fad . 


aT Deane: tor bo G logical ¢ rransmission of these fen athots 


Orevalance far. these ¢ 
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+ Achiovement tests and jeather recommendation ; which are also mentioned Wess 4 
the federal regulations: for implementing Public Law, 94- 142, likewise qualify’ as unt 
“measures of behavior. When evaluators are using instruments tG. assess behavior 
“in a Social, setting: they 3 are ‘operating within’ the sacial adaptivity model. 


© Definition oF Normal, sabnat nai % . : - 
ach social system. is composed of social Stat Uses, Soci iak ‘le arid social. norms. 

The social statuses. are the positions which persons: occupy in a system, such as 

the position ‘of teacher, pupil, Principal in ‘the school. Associated” with: each. 

“status is a social role which consists of’ the” ‘behaviors: *of. persons occupying: the. oh 
Status. “Persons, participating in a social system. share common expectations. . Sate: 
concerning. the appropriate behaviog far persons playing particular roles in the © °° ~ 
System. These. shared behaviora!: ie Sor ci are the norms of the: system, The ha 
‘term “normal”. from: a social deviance perspective does’ not relate to biological | < 
signs: or have’ any necessery relationship with, the biological organism: Normal ; 
behavior is that which conforms: to the expectations of other members of the~ ; “Fo a 


group, Deviant oF abnormal, behavior. i$ that ‘which does not meet group a 
* expectations, —- 


* “Assumptions of the Social Adaptivity eel eo “ty 7 "5m ‘i , 
. The ‘first assumption of the social adaptivipy mace! is That there: are’ ruitipie: 
~ definitions. of ' ‘normal’ behavior which vary fram social systems ta social system : 
and from role to role, It is “normal tor, a studeat-to yell aed jury around when “ 
Sattending a pep rally, but such behavior would be judged as “abnormal” indp> os & 
“arithmetic clas3. There is naming per se, which makes ‘yelling and jumping either = 
“normal” of abnormal." Ut j is only in rélation to the norms of apartiqutar social : 
S “Setting that the normality: of ‘the behavior can. be ovaluated, Thus, the sacial 
adaptivity model” is highly situati¢ n speatic. Toa determine’ whether a given. e 
behavior is “normaty’t one must Kntw.(1) the social system in. which the person. *. 
4S operating, (2) the status the persor: halds i in the system. and its associated role, 
(3) the role expectations Or norms for. judging the performance. of persons © 
i : playing that role, and (4). the behavior of the persor: to be evatuated. a a 


tis 


* Z 

a A secorid assumption a the social adaptivity model is that the norms are not 

; __biotogicalty : deterrningd. The narms: by..whick: a. persons. role. performance eis 
judged are qvolved in a political -definitional process. Thosg. persons having the ae 
greatest power in the ‘social system imapase their definition af “normal son jess 
“powerful members. Typicaliy, parents, who are the most powerful members-at 
the family, . -impose their’ behavioral Norms on their children, Teachers, the mast” 

*. powerful person in the classroom, typieally impose their behavioral, norms on - 
‘their students. ‘In’ the larger society, those. Cultural groups which: are dominant 


politically and. economically impose their behavioral standardsgon less. politically -. 
powerful groups. es ar : ; cae 


» 


~ y ~ 


The achesiive <oiurs which culfently guides American public education was 


established as: a result of the political cand, economic: dominance of the 
es Anglo- American cultural group, Public school norms req uire thatathinstruction . a 
oe in English, that a student's ianguage development be > determined | by. eke 
evaluating & prof iciency in. the English language, and” so forth. The growth. of- tae 
testing movement. has been. intimately associated with > the ‘public: schools. 
. Standardized ‘academic: achievernent and aptitude tests are indirect measures of* 
ne. extent to which. a student's ac Hemic performance meets: the expectations of | oak 

e eacher evaluations ¢ re direct measures of the extent to which . a 


“othe schao} 
ee a rmance, meets schygot | norms, Both types~ of measures eae 


Social System. Specific Value Frame. a : 2 = 


the % ‘medical model; which iss ‘based * on. universal: values, the: social» 
y mode: is based on the. vaiues of each: social group. ‘Those vaiues-are “ 
revealed saetlbe the’ norms aerate sae Social role in each ‘social systern.’. . 


~adapti 


. “The vac ie the school may differ’ from the valng di the student’ < 
r the valefes of the. peer group. The behavior. of.a student may fulfill ro! a 
ect tionssin, ‘one grok um but may violate the. rms of ‘another. Transsystern 
ranseul tans ak interpr retation of the.’ ‘normal i. oMbehavior are ‘inaniconticy 
Hever. ques ai ihation. beyand tne ‘ide citic roie eing evaluatedt cannot be 

justified uniess the Foigs and noxmative Structures of rhe lwo systems are closely 
Ri inkeck An example of Joseiy linkectenormative structures would be. high school 


ieee ¢ rottege’: wack we sohox a. ‘ : Ss . “a <® 
. a WT Nes - : _— : 


‘ cettsge ta 


: Focus of Assessment ; : 

“Unlike the maciical model wich VIEWS pathdtogy az an airibute which the: 
‘organism carries into” “every social situation, the social adaptivit y model focuses | 
an SSeSSinnge behavior, Abnormailty or normality are jucgrhents about vehavior, 
: not about the state of the organism, Abnormality or nor rmatity iS not regarded. as’ 
‘a characteristic c ar trait of the individual whose behavior is: being evaluated. - 


ae 


. ‘ Behavio 36 35 sole specif ie “and: norms gre role specific. He mnCa, Judgments ahout 
Sareen oT ave SOAR Im Baty NOG. LO TRL EEAS. ave ee thespecitic-roleZbehaviors 
being evaluated, : Sy 1 ay ve 


“Properti ies of Meacireank Instruments. - 7 3 , ; hee 

Because 5 Ocak groups ree -Gyniz ze unacceptabie,. yeceprable, and Svéeopiaty TO, 2 

perfortnnee, athe : he social ads aprivity model issbath a deficit ane an asset miedel.* 
* The full range of “of measivement-is-passible. Thecefore, instruments designed as. 


tect: or indirect measures ot role per formance should have a a full distribution ot” 
, Cares and tend to orm a. rocmal cli stribution. fram shouid . fattact behaviors: 


i valued iby the qraup and should have av Righ anough ceiling to identify 


. - 4 outstanding performers. os : = ; 7 ~ a an get 


Validity: : : . a 
The: validity « ‘of a social adaptivity measure i is detéimined ‘by. its ability ro identify 


: tose persons: who are succeeding and those’ who. are. failing to “meet group: 
“expectations.” Tha assessirnent of family. role. pesformance- sbould reflect the 


‘ - family" $ expectatians; the: assessment of peer group performance should reflect 
= peer" “group evaiuations; the . assessment of academic role performance: ‘should g 
“reflect teacher evaluations, cand. so. forth. The predictive ‘validity, of academic” : 

ae achievement and aptitude tests has: traditionally ‘beere measured by. their ability: 

‘identify: those students. who. are. judged: as competent.or as incompetent by 
the. Jeacher, Criterion: ralated ~validity, a8 earenty defined BY. persons: in. ‘ 


i definition of validity (Cleary at al., 1978), 


“te is important to. note ‘that the person designing a test of social adaptivity’ does 
not: “impose a “set. of values. -on the ‘system within “which behavior is ‘being © 
evaluated. “System yal ues 2: taken as a “given!” when. measuring social" 
\ adaptivity, whether that sysfem be- the child’s family, the school, the peer grOUP . . 
“or, the: ethnic community. Social system measures should embody “the viewpoint 
and. the evaluations of persons in the systerns in which the child is trying to. © 
~ aghieve an. adaptive’ fit Tradits onal psychometric: definiti ons “of: “criterion: related < 
oY validity’ fit the:social adaptivity ssessment model, The test desighet accepts the. 
“value ‘judgments af persons : inthe system as to the types of behaviors which ares $ : 
o “socially retevasit-and use byl on! ‘socially important” iClgary et aly, 1975) pe 
> 23). “Criterion retated validity... is simply the’ extent to which test scores are 
elated . toa socially important ¢riteri on measure’ “(Che ary et al, 1975, p; 25). 
The ‘deci sion as to which behaviors are ° ay importarit” is determined by the 
ralativé power relations in the sacial sy /SLEM Y ” oe 
‘ y ; : és 


7 MN should be noted, that Xhis deft nition requires 2 direct measut e ‘of é6cial role 
. performance as. the criterion. i, @. school grades, ‘teacher rating, peer rating, etc. - 
Two indit rect measures ie. test-test correlations Such as "intalligence’ * tests fie 
correlatedt with. “achievement” rests are ant appropriate rmeasuras of the validity - : 
of asocial adaptivity, assessment ae ek. : ne. 


Vv 
. 


hich a particular direct 


_ Another Ass Ue Js thar of _determining. the extent to 
rheasure of a. child’s performance in a particular social systern accurately ~ 
. represents. the: avaiuations at other: members of the social system, Does a . 
particular: teacher's rating of a chile’ > performance in scheal reflect the rating © 
which would be given. by other teachers? Does the peer rating atone member of, 2 
‘the peer group adequately capture the ratings ob other pear group members? >” 
“>. Such questions referto the ‘issue ‘of inter-rater reliability. They are answered by - 
: correlating the judgements of various. members of a. social system with each 
other. “For example, correlations between the reports of ‘a child’s adaptive > 
behavior secured independently from a child’ § mother and father would provide. 
; information on inter-rater reliability in the family social system, Correlations” 


aeerned 


ae 


~ “between ‘ratings. ‘given. by | various. ‘teachers would provide’ information on the 


the group. ‘As outsiders, they are not. privy. to the subtleties of the behavioral 


Of a social worker or asteacher. ‘They are “outsiders” ~ Their, judgements reflect 


family... 


° - 
- . x 


Racial and Cultural Discrimination. ° 


: “af racial and cultural discrimination is directly” related to the accuracy of tHe test 
Sin predicting the evaluations which system members -will make of the child’s 


“the Aature of test fairness’ when ‘operating from a Social system assessment 


constant értar in the inference as a faunchon of membership in a particular 
_ group” (Cleary etal, 1975, p. 25). Onerationaily, & test would be considered 
fair” or “unbiased” if the foliowing. four conditions ‘are met. (1) The variances 
are homogeneous for the populations being compared. (2) The correlatian 
coefficients between the test scores _and. group evaluations of individual role 
performances are norizera and equal for parsons of different racial and ethriic 
“groups. fa The regression lines for: persons ‘of differ rent racial and ethnic groups 
“ate paralie , 1@., have similar slopes. (4) The. regression Nines for persons of 
‘different racial anct vathnic geoups have sirmiar intercepts. > 


In a “social adantivity assessment model,. the fact that ‘one group may have a 


° system than arother does hot tnean thatthe social adaptivity, measure is tacially 
or-culturatly discriminatory, so long as the four conditions listed above are met. 
For examole, if an evaluator were interested in “predicting which’ ‘students would - 


such knowledge would be. required for acceptable role performance i in the inner 
city, The Black. Intelligence Test for. Cultural Homogeneity (BITCH-100) 
developed by: Rabert Williams (1975), a vocabulary test of 100 wards selected 
fromm the Dictionary of Afro-American Slang, could be used as the predictor. The 


pai th 


feliabitity of a Particular. teacher’ 5 assessment of the child's adaptive “fit inthe = + | 
school, and. so forth. The judgements-of persons. who are non: members of the 
social. system cannot be used to determine-the reliability of the: assessments. 
made. by system members. Non-members are outside the normative structure of ° 


~ norms> which operate: in the group. Knowledge of those norms. iS what 
differentiates the “insiders”. from the “strangers”, For example, a-mother’s 


_feport of a.child’'s adaptive fit in the family cannot be. Validated against-a report ° 


: the. socfal norms of the _systems, in which ‘they, operate, and: not that of the 


. When measuring a child's adaptive fit toa particular social system, the quagtion — 
+ performance. Traditional psychometric definitions of test. “fairness” fit: the - 
. sOciat- adaptivity model. ‘Cleary etal (1975) have presented a clear statement oF - 


model. "A test is considered. fair for a particular: use if the. inference drawn from. 
the test’. SCOra 15 made with the smallest feasible random erear and iF there is na” 


-higher average scare On atest than anather group ar that one group may receive. : 
werage..catings..on. thein.social. role. perfarmance.in.a: boartiqular-sQ@i ghee 


perform 5 successfully in the social systems of thé inner city, he might ask ther to - 
_ take a test to measure their knowledge of black English on the assumption that _~ — 


ae * * > 
oe: . f et 5 ae 


sinner: ity. -Likewise, the fact that central _city Youth might be rated higher, 


~ considered. evidence. of’ ‘bias.’ If the correlation: coefficients. were “of simitar 


“and an the criterion might be ‘tower: than for central city students would. not be 


= adaptivity assessment model. Such a situation is.dépicted in rage 1A. 


as i . 


a ae “as “biased” and ' "unfair.” "YA typical situation im social “adaptivity measures is 
a depicted in Figure 1B. tn this case. the average scores of one group on both the 
_ teste and ..the cr ierion. are jower than the scores “of ‘the other group. The 


. 8. .3Coring.grdup. on the criterion measure, the pecformancé of the lower scoring 


 Yroup | is overpredicted-Fhat is, the lower scoring group is predicted. to perform ; 
better in their social roles in the social system than. they are actually likély to- 
>perform. If the two arouds are cornbines to calculate a yOint regression fine, the hag 
“vr joint line will Fall between the fines for the individual groups. Prediction from oo 
: > the. joint regression dine will likewise. overpredict the lower scoring group's , 
» probable social rote oerformance. Henep. this situation discriminates against the | 


“higher scoring group and i in favor of the lower SOT aroun. ~ 
a situation in Arr a = ie none of the criteria for a “nonbiased” measure 
‘is depicted in Figure. 1-C, If the intercepts for the regression lines are-different 


77 


of he criterion performance is NOt possible. When the majority regression line is 
used: to predict minority role performance, minority performanes 48 Overpre- 

“dicted: above. the pa: int at which the Vines cross but underpredicted. ‘below..the. 
~ point at which. the lines cross. Belk : point of crossing is precisely the 
portion of the distribution. in whicl decisions ate ‘made about. special 
education placement: Tf the low “scoring ‘group iS. ‘a racial or cultural minority, as 


performance low seOnnG ee children. 


* fact’ ‘that students. from, a rural ‘southern backgound or fan a adie class : 
> background. might earn lower average scores on the BITCH-100 than students . 
- reared. in the central’ city would not be evidence that the test was: racially or o 
; ._ culturally biased, if ‘the test predicted accurately. which. students would perform. < 
their social roles in the’most acceptable fashion as, evaluated by persons. ‘of the 


overall, in their performance: a other persons of the inner city would not be. : 


+ smagnitude, the regression lines were parallel, and. the intercepts were. the-same, os es 
~ the fact that the averag¢ | scores for. rural orfor middle. class. students onthe test. < 


“However, if one or more of the ious enfteria. are not met. then the test i is defined 


regression jines are parallel but have different “intercepts. When the regression rs : 
“tine of the higher scoring group is used to predict the performance of the lower * 


+. regarded as evidence of racial: or ‘cultural. discrimination within -the: social , 


sang the ines are not mae the regression lines. will cross, Accurate prediction : 


hae mtg si 


Js frequently ‘the case with staridardized “intelligence” tests, and’ the regression 
tines cross, ‘the situation would lead to underestimating the actual student’ role ; 


To summarize, the traditional peychometric delinition of test bias" fits ‘the é 


social adaptivity model. The dehiniGan takes the values of the social system a as a 


a . 
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Veients, samme. aionk eo regression = 
. tine, and same interceot for regres! 
“ “sion, ine, 7 oe ie 


“A “biased” measure: nwo groups 
with. the ‘same correlation coeffict 
ants, and regression, slopes but, dif. 
ferentintercents: over predicts ariup 
with lower average, scores. 


ne a een coe at tcC CEO. 6 ttn min nner Siete | hoenent tent 


“biased” measure: > two groups 
with. different correlation ‘coeffici-. 
ents, - “regression ‘Vine slopes, and re- 
<*> 5 gression line. intercepts: overpre- 
dicts ‘above the corssed lines: and , 
underpredicts beiow . _the crossed , 

= ines, me a. 
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Purnoses| for: “Using she Sociat A lap tivity, o or ‘Sacial ‘System: Model. a ae 
“There are two: distinct but related purposes: Sfor assessing a child! ‘s behavior’ within : 
“othe ‘social adaptivity. -or social. “system assesiment model, (1)-One- ‘purpose. ‘for. 
a assessing, cbebayi or is” to identify, ‘the nature: ‘of “handicapping condition” 30 “that”. ~ : 
‘programs: treatments, Services, and other resources can be made available to the. ae 
Student. Ader cation “oF the | “handicapping condition” 8 required by. Statutes, vss 


“ categor es 
“be. rade > 


whe ‘put f. Th His “raneton ‘ts cay ‘ralaied? to. 
AS. DA. second “purpose for assessing behavior. is ‘to 
mr the “pupil's -educationat. needs in order to develop 
oreferably interventt iohs designed as part of a coherent 
i echo atis al bian's The Ewe purposes are simi iar ra the nwo ‘dimensions 
“tests. described by Carver N97 4): | ne pays chomeiric function and the — 
: echumetric ce. = @ , 


inte « 10 


. *y 


me yaf ingts facuseston providing measures which will” 
' ifeinking ‘of individuals on the behavi Or measured, The a 

aim ee ie ie onus is to hightight cli ferences among individuals and to : re 
—_ rank them according to their oraficiency ins’ performing some type of socially! 
this reason, scores on psychometric . ‘tests, are 
! vem some’ ROP MAT VE sopulation > Standard sco 
identify the todividual st relative position in the distribution of scores of persons 
-an whom the. test-was normed, Litde’ change: in relative position 1s anticipated » 
fram ana administration at the tast to the: next since scores are ordinarily - 
standardized: by. age: “Such stability inrelative rank iS Considered! an indication 
that the test is reliable. ” : “+ 
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vatued rote “behavior. 


The edumetric” ‘functi on Cot tests: focuses on providing information on the 
student's current performance. This> information: is ta ‘be used to design 


: ‘educational interventions in ‘specific acadernic areas, Edumetric ihe are: closely 2 


a. series of “graduated educational oper criteria which have been’ : 
~ established as representing stages in accomplishing the goals of the curriculum: 
- Ofdinarily, raw. scores rather than standardized scores are used. Htis anveionted> 
7 ‘that a “pupil’ 's performance as: “measured: by the raw. ‘scores. will improve with’ 
7 instruction., Slight emphasis is placed on gomparing the pupil's performance with 
‘that of. other pupils. Rather, the individual pupil’ Ss: pérformance As measured 
“repeatedly” and ‘is compared over time. The expectation” is that a- student's i 
* performance "will progress. through the graduated series of edutational objectives - 
Jif given APPrap Rate ASSLER, , 
Both psychometric and edumetric tests fit oriiee ‘the social adaptivity or social 
: system “model because they . both measure learned: behavior which ‘is evaluated e 
against. standards which have been setby a social group. In general, tests which ; 
~ have been designed for psychometric Purposes, such as so-called tests of: 
i intelligence ; and aptitude, are not adequate as edumetric, measures. Fore example, . 
; NO “ane would attempt to design an educational program w. teach -a. child 
~ arithmetié on the-basis of arithmetic subtest scores an the WISC-R. On-the other: 
_ hand, edumetric | measures are not generally useful-for Dsychometric functions, 


‘ fs ay 
~: : waa * 


‘ \” Diagnostic Valties, 
ek Diagnostic values \ within a social 5 system assessment me net cfier markedly from: 
. those used when operating’ within a medical macdei. The rationale far these . 

values is based upon the sociological concept of primary” and secchdaty. deviance 
_and the deviance process. : : 


There are four stages in the development Of a deviant career?*Stage 1 ; 1, primary . >. 
“deviance, pecurs when the behavior of an individuai-is first labeled as abnormal 
Pe bY “someone in the system, Stage 2 emerges when others fm the system: wtake ~ 
action to counteract the behavior labeled as deviant. Negative’ sanctions may be 
applied in an “attempt to “normalize” the | behavior by bringing it into 
conformity with system. norms. Stage - 3. is rected when there is role > > 
: reorgantzation within the sytem.-The person exhibiting behavior defined as” ” 
deviant is moved from the status of “normal’ "into’a status reserved for those >< 
= Wwho-cannot- “Or swilkeonots “fulfill<"narmat’-role™ “expectationisy “Large” “soca enn 
institutions, such as the - ‘schools; - ohave formalized many deviant “statuses -to - 
“8 accommodate persons with a large variety of deviant behaviors, ych as educable ae 
.s *mental retardate, learning, disabled, ¢ educationally handicapped, -and so forth. in ; 
= ~~ ipmore extreme cases, the. Offending rember may “be removed. fromm the social 
system by being expelled From any status. in ‘the systern. Stage. 4, secondary | 
" deviance,. occurs.when the individual defined as a deviant internalizes the. deviant — - 
*~ role, Risllasaiie the self in terms of the deviant status, acts out the, deviant” > 


ve 


eo 


Labeling. behavior as dein initiates. the deviance process. “Because. social 
: 2 systmes * “are powerful agencies. which: ‘can mold and shape “the careers of . 
“participants and, ultimately, may influence the individual's social. and psycholo:" 
Qical - identity, erroneous ‘labeling. of: behavior as deviant ‘may have» serious’ 
"negative * consequerices forthe individual: “taunched on a deviant career. Thus, ae 
“within the social -adaptiy: ty model, the. ethical, code.is to avoid. Aabeling any _ an 
: behavior as’ deviant if” there is a shadow of a doubt about the ‘reliability. or ae: 
— validity. of the label. ‘Conversely,. the’ ethic. of the- social adaptivity: assessment. 
a model would.,. support ‘maintaining ’ a chitd in the status of ‘ ‘normal™. as S18 as. 


2s 


aes Because: psychometric . tests ‘are used: for. malting sdinirigteative decisions: in A 
categorizing children for’ programs. and are based. on :norms whicn direetly - 
compare a.chi Id's performance with. that’ of, other childrerr, the interpretation 
se and use of such tests is likely to (tiate the deviance process. For this reason, a a, ~ 
“ Jow cut off level. for defining a nerson.as “'subnormal” or behaviorally deviant is ~ 
; recommended. In general, .two-or more standad deviatidns below the mean for ; 
"the [standardization sampie, ‘or. the lowest” 2.5 percent, provides such a 
is conservative criterion (Mercer, 1973, chapter: 14), This criterion conforms. with . 
the current definition of the. American Association for Mental Deficiency which . 
defines. subnormat performance as scores" mores thant two standard deviations . 

: ‘below the mean on a standard measure (Grossman; 1973). eae oo SS 
The problem of initiating the deviance’ ‘process is fess acute when using adumetee ws 
_ measures, such “as. teacher. constructed tests and tests linked to -avaluating. the 
= achievement. of specific. objectives ‘within a° criterion: referenced: curriculum, 
, Since the chai’ ) present per formarice is compared with his .or. hef OWN past.” 
-pertarmance rather than with a normative, population, the testing: focuses on 

designing interventions rather than making comparisons with others. However, it 


e 


“should, be recognized that invidious” comparisons. are. still possible” eveg when 9 
using edumetric-tests if children whg: are further dlong the curricular cqntinuum ee 
-are compared “—m chitdeen who are. at coer stages in me curricular continuum. Oe aN 
. } i as 

‘ : 


The “General Intelligence’! Model 
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The general intelligence ibe which has also been ¢ ted the pluralistic model 

*(Mercer, in press): was first introduced by Alfred Binet when he developed a test 0. +6 = 

* of learning © from -which he ‘attempted to make inferences’ concerning: the 

- “intelligence”, of the. childs: ‘The attempt to. make - inferences about a child's 

: intelligence, aptitude, Sotential, ‘or mental ability from test performance has 
been one of-the major threads in tasting a0F the Sa erent -five vears,. 
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The Federal. Register lists measures of * ‘general sietiigence” among these. testi. Ba S 
: ‘which ‘may be appropnats in the asGessiment of some types. af’ Sada a (Rules > 
vy... tS, 


“and, Regulations, 1218, 532, Evaluation, Procedures GFL). ‘It requires: that “tests: 
Sand” ‘other: evaluation, materials include those tailored to assess specific areas of 
'. aducationa! -need and. not merely those which, are designed to provide a Single» 
general: intelligence . quotient" (Rules and Regulations, 21a 532, Evaluation as 5} 
* Procedures (B} }. . Fhe imo sication af this statement is that assessment procedures 
will include some tests. “designed to provide ‘a single generai apre ligencs 
quotient, “but that such measures cannot stanc-aione. 


“Questions Addressed by the Generel intelli ‘gence Model. —_ , : te 3 
: “The general | “intelligence assessment mode! attempts t ov answer ¢ questions. about = 
the individual’ ssmental ability, intelligence, Or potential for learning. Ioview’s > 
“Tntell! tigence™. as ar attribute which the individ ual’ gan apply_in coping “with. 
solving problems in. new situations. For, example, Terman anc ‘Merrill (1960, p.. 
5) identify one of the distinctive characteristics: ‘of the Binet- ype scale as “the 
concept of the mheasurement afa ‘general } intelh igttreg" which functions. as. mental 
‘adaptability | to-new proklems:” Wechsler (1974. po. 3.7) provides. ‘the following 
definition: =. oo 


« , 7 : . vs 2s oe 
‘Inte ell gence ig the overall capacity of an individual ta understand and, sore 
with the wort! around him... (YH) tt Phe definition Sconceives of intelligence 
as an werali or global entity: that iS. a multidetarmined and multifaceted 

a antity tathertnan an independent, R dety le! ined reait. ‘2) tx avoids ibe JA Be ee 

, - Out any, abllity, however dante ; Spal ‘act FRASONINg:. Por, 


NOCD “y MADINA, se is novia “inal : 

‘ ery ‘atat, serrainh yet is the sarne sarise th sat raagoning, ¢ ramon y verbal flusney . 
Bs “ee 4 “ete. sare 50 ‘regarded, Rather, i is something: that is inferred trom the way ° : ke 
these: gointas are ‘anifested under “different sontiitions and circumstances. _ 

SEPT tT. One can infor an intiviciual’s intelligence fram how he thinks, rales, moves, 


a almost frorr $ ne rHacts £6 SU ial GP one Rid of oa - : 
Indeed,. i such responses bas been the usual way of te 
judging intelligence... {inferences are made byl comparing each subject's test . cae 
“oertormance nar with a composite age arqup but exclusively with the scores 
farmed by individuals ina G single (that is, hiscor her Own? age group. : . Each 


cays appraisal 


Pesan wesred js ass Prec! an. iQ winch Boe nig. age represents nis ralative — - . oe 
a, This 1Q, and all others similarty antai ned, are deviation 'Qs 
te the amount by which a sublect deviates above a: bein the 
“A Caverags perforgancy of individuais sof his own ane farmpnasis acieted } . 


a intatligance rati 
a singe thay! ind) 


“intel tigence iiadel: inialliganee i$ an conceived asa global entit ry ¢ ar capacity. 
that is (2) inferrad from: the current behaviorrof the iAdividuat (not measured 
directly), by (3} norparing the individual's performance with athers of the same 
age, The inferential model ipctearly statistical It defines intelligence in tarms of 
» the relative rank of the person’s performance compared with others of. the same 
age. indeed, Wechsler is quite forthright in declaring that “no attempt has be 
made to define a priori the social and clinical. significance of any given 1Q."* | 
short, no argument és made for the predictive validity. of the test inthe sense in oo . 9, . 
whichs,’ “validity” is defined within the social system model. ee the earlier > : % 
: discussion of ane social system model. i . : “ae ae * ae . 


~ 


Finally: Wechsier . ‘recognizes that ao person's ‘performance: ‘and, “hence, the 
ze inferencés which: can be riade from that performance, are influenced by cultural. 

and. sociaeconomic background. ‘He ‘emphasized the importance. ‘of “the a 
examiner's dwareness of. the degree. to which a subject's responses may be - 

Influericed or condi tioned by, his culpural “and - ‘socioeconomic backgsound’” 
_ (Wechsler, Pp. 2} Dut provi ides” no, procedure for astimatl ng that influence: or* 
“staking? it into” secount, in n interpreting test Scores, 


ea et 
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mt Definition ‘of Normal/Abnorml 

The definaion of “normal"* and: abnormal” within hes “genera! intetigence 
“model is assent: aliy a statistical « defin: ton, The statistical definition of “normal” 

a ‘familiar to- anyone who has been introduced to: the ‘concept. ‘of: the normal > 

4 cone. Jn: this model, an: indivi ehual is described by his or he? relative Position. in a 
‘frequency als oenon of scores of other persons who have taken the same ‘test. 

: The ' ‘norm ‘for the testis the ‘statistical average for. the population on whom 

the test- was standardized, The general inteVigence model:defines. abnormality 

. “accerding to’ the exterit to which an individual varies from -the average of the a 

: = population on a partis ular, set of behaviors. ae a ae 

2 — a Sooge “Sar Vay Wh x a a = wo 

: Establishirig Khe ‘statistically normal, is as ee process, The investigator 2 : ’ 
specifies the poputatian of person? an wht ch the norms will he based and then , - 


’ 


measures the entire seria or ag repres EAU sample of the population on - 7 
~ the sberavidrs being normed, Scores om the measure are organized into: a’ 
. frequency’ distritution, ae the: average ‘scores — , the. statistical mean .—is 


“ealeutated. The mean is ac cepted as the norm, Custornatily, pers ons with scores * 
~ that deviate not more than one standard deviation above or below the mean, are” 
“regarded. as fai ling in the “normai range’ “and make“up approximately 68 percent” 
af ne populati on. ‘Therefore. ‘in “the statistical ‘definition, normal equals the 


sta sucal ean plus Or mins US OE 8 standar¢ j devi ation nee the mean ‘ & 


« 


In. astabiishing a statistical “norm, the. tes t maker. uses the characteristics of the on 
particular. population being sisiee to “establish: the boundaries, ‘of “normal: os ey 
When the population on which th testi is: normed ae changed, the boundari 28.0 
“gormal"’ will also be modified. Tn ; a fundamental sense. the persone constructing: | 
2 and standardizing a particular test determine that range. of behaviors which wil & 
‘be Eonsideced ‘normal’ when they madé the decision concerning the population 
an, which the tes 13 shail be normed scale ale 1973, pp. 2 ff. ), as 


SY _s 7 Asks. ron 


on There is a. jong tedingn in psapholoaical moteg: ‘supporting’ ‘the snpportaney of 
Sse be © consi ered to he part of the universe from. which the ample was . 
selected for purposes ‘of norriiag thetest. When groups can be shown to be | trom 
different - populations,- statistically, it is not appropriate. to: combine those >> 


we 


: populations: for suspen of: calculating a singt “norm for the t test Merde 

- When a statistical ; “model is used to define, normal performance, ‘thes 

+ emerging: fiom _measuiréments’ takeh - On" ane population.. cannot. me safe 
“generalized: “béyond ” that “population. “Unli ke. thes medical _médel,: 

definitions of normal’ "are neither. sui ara 


“the ‘general intelligence" model, inferences are: tiade aout. the : individ 

“ah telligenca” "based .on. his.or her relative position i 
aMother. | persons Ditwhom the test was normed: ououy ‘accents capi 
cannot be measured: directly, ! Secause that watild require. assessment of. 
genet 7: omponent of performance, the. genotyne. An individual’s genot 


tye: can 
‘only be ‘expressed through beha avio earned! ina soci and cultural. -settin 1 


‘phenotype. The test measures: what. a ‘person has learned, his phenotype. On t 
- basis.of his performance, . nfeferices are frrade. about: the: nature, of his genotype. 
othe, general. ittel! tigen ce model. assumes that it is possible to ‘make ‘valict. “ 


inferences. about the. gehotwoe. trove = ‘prop Serly normed. and. administered teste. 


Persons: usitig the’ “General intelli ence” ‘ mode are constantly makini inferences, 
Gg 


‘s . about: gencGpes | on the :basis of the: pactortnance of phenotypes. The Togié s 
a behind these ir STAN GES iS re atively simple, pat the a asst umBrjons are rare ly metin « 
an actual practice . . 


ave. ane bequal oppor tunity to iearn, the types af cog 
‘linguistic, ‘and mathematical skis and to acnuire the ry oe t 

‘tests 2). of they are. equally motivated to learn? these: skills | and MS : 
“information, ; 13), if they are etjually motivated | 10 exert themselves “ih a te 
“situation and equally. familiar: with the demands of the test sit 
: are’ audally free of emotionai disturha 
- their perfosmance 


| VE two ‘Bersor 


uation, {4) if the 
ice and an , s feties, thet tmight, interfere with. - 


_ (5) if they ‘are: equally ‘trea -of biol: sal dysfunctiditand oe ee 
» Organic: difficulties that might have interfere 


the tes tor might intertere with test eeriaie 
ee . their performance on a ‘test 


ad withe their earning the znaterials j in. 
mance’ Sthenany’ geen hetwaen . a 


Ee: knowledge # ig sebabip ‘the result of diHerences wn their intellectual endo 
or learniniy potential. Simply: Stated,” 
actors are equal, thase persons who 


ee ine most. and WAG. perform tN 
“probably have the greater mental, capacity than’ those 


who- learn the lense and: 
~gerfarm: mos? poor! 


y. Of course, the major difficulty: ins applying this logic: ine 
ee interpreting. test scores: ‘within a general latelligence. lade is th, 


at all factors are. 
Seldartggiuat. oa. & : a 


- ci = 


Value Frame’ for the. Model.” : 
genet intelligence” model is. based 9 on ‘the. premise that t perons who earn 


. 


Lee F Rescetank Bs ea “e {Me es 
e focus ‘of assesstnent ison the, ‘behaviot: of the: child: in ‘the. test: situation. 
owever,- ‘the evaluator is. concerned ‘with going ‘beyond-a description of. the test. 
behavior. and | “making. ‘inferences about the - student’ S: -general intelligence. a ee 
“Cautious ‘inferences about: a. ahiid' 5: ‘probable. tearning | ‘potential may be made : 
rom “his? ‘et r her gerformance, on’ a teat, if the assumptions of we adel can be: 


Properties ue Measiireinent irsstruntents, . Ee : : 
“instruments. typically used in’ ‘the general ihtelligence ‘model a are <G-called ‘tests of . ae 
ftelligence, such as the: Variqus “Wechsler scales: and the Stantord- Binet. ‘Such’. : 
L tests: were first developed sange’B “Bi yet -arid Simon. in the. early | 1900s" to. ‘identity: 
ee French children: who. we d not be likely, to: benefit frorn a “regular public : 
school. education. ‘Binet ‘aiyempted. to ‘chuose items for his:test with which all 
7 persons participating in. French, society would: ‘be familiar. This. practice has - 
= continued, Consequently, the’ ‘abilities and skills. and knowledge covered | in the’. 
~ typical test.are selected: from:the particular ‘cultural stream which is dominant: in* 
a) particular society. \Mercer,’ 1973). Although. some items, such as arithmetic, a 
; may: be directly related. to acaclemic: curricula, ‘others are drawn Fearn the ¢ gener 
“cultural, pool. of the dominant “cultural group (Mercer and Brown, 1973). ‘The. 
‘language of ‘the test is the’ language of ‘the’ dominant cultural*greu.. The. tests | 
‘attempt to measure how “euch the. ‘iedividual has learned about the lanquage, nae 
; style. -of thought. history, political and’ social institutions of the dominant culture. ~~ 
< and the extent 10 whith he’ or she has ‘acquired: the. cogn: “tive skills valued by the: oe 
- ‘dominant group. Any” test of: an. individual's learning ie. ‘achievernent inal’ 
particular cultural’ s setting: could. be used as “the basis. for: inferring learning 
" obtentials “provided the. assumptions of the inferential model for ‘inferring 
- “intelligence” are’ cat. However, in individual assessment the individually. - 
administered. test is preferred’ because ‘there are fewer uncontroltéd variables, 
such. as the Chri” ‘5 reaching bility. the chitd” 5 fativat: arta ue x _baper- and 
pencil task, nd’so forth. ; re a oa 
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_ The cana: of so- o-called te sts ak intelligence” ane ‘tests. ‘of achieve: 
‘ment’ is cogently. described by Wesmiar aie ~Jencks: (1972); and Cleary et 
“all (1975).- ‘Wesman states, AN ability t sts — intelligertds, aptitude, ae 

achievernent => “measure. what we india: ‘has learned’ — Land ney Y often, 


1 Such justification as we. 

h e-for.our. labeling system residés entiely j in ‘the | purpose for which the test is. 
bused, Not. in the test document itself. Af oui intent is to discover how much the® 
examinee. ‘has: learned. ina particular. atea; label the: test an: ‘achievement’ 

at if our. sintent is to Predict what ‘succeds ar. individual, s.fikely to attain in: 
learnt 9. anew language, ora new. job, we ‘seek those. specific previous: eee 
the Possession of. which bodes. favorably. for that future learning, and we.label < 
the't est an. ‘aptitude’ test ora ‘special ‘aptitude test. qf our. intent is to predict. 
future. ‘acquisition of } earning over broad areas of environmental. éxposure, we , 

hose ‘previous Jearnings the Dossestion of which wil! es relevant, tO as: many. 
ure earning “situa tions: as an anticipate. Thi? test awe. label - fe 
elligence”’ test! The: cisctoas ie test itepris or sample’ tasks: for the oe ; 

i purposes: may Or may, not differ; but in each ‘instance. what iS measured is what. 

- was previously: learned. We are not measuring: different abilites: we are: ‘merely | 
attending to different criteria,’ “(Wesman, 1968, p. 269.) . . ae 

Shee states, ‘ ‘Many ‘test manufacturers)  didkinguish, sain examplesbetween:, 

ae ‘achievement’ and ‘aptitude’. “In principle. achievernent tests. tell whether: 

7 . students haye mastered same body of- material that. the tester. deems important. 
“Aptitude. ‘eaets theoretically tell whether students vare. capable of master ) 
body <of material. the -tester- deems’ important. “In¥oractices however. all tests. 

measure both, aptitude and achievement. TE. two. ‘students have had the’ same. 
‘opportunity ‘to. accice verbal skills, “and ‘f one has -p nicked “them uR ‘while the 

‘other has. not, the tast. does indeed measure ‘aptitude’. But if one chtid has been 

raised speaking Spanish and another English, the ‘test measures the Spanish- 
aM - speaking chiid’s mastery of a. foreign language. If the Spanish-speaking child does « = 
6a, worse. than. the English-speaking, 5 this shows lower, achievement in this area, but, 

s it need not imply tess aptitude. . . When everyone 13 equally ‘well prepared, 
_achievemeat tests becorne aptitude tests. When feople are. unequally prepared, 
iapti tude tests become achievernent tests. fro light of ths, we will not make any 
rigid~clistinction between aptitude and achievement, We will sirmply® try to use 
‘ “the term that seems appropriate: in a given context.”’ (Jencks, 1972, pp. “55 56). 

- When persons undertaking the assessment of children usp the three assessment | 
“models correctly, they differentiate carefully ‘between. the use of a test as a. 
measure of “achievement” within’ the social adaptivity mod 1 and as a measure 


ay ee 


“Sntelligence™ “Within ae pluratistic-or gerierar intelligeri¢e model. = 


ion 


; Finally; “Cleary etal (1975) teach a similar ‘conchisiohi “There : are no differences 
an kinet, ‘as noted earlier, _ between /inteltigence and achievement, or between. 
“aptitude and achievement. There are, instead! four dimensions appropriate to.the 
. * description -of -teses and the repertoires they sample. ad ‘The four dimensions 
“> discussed are- breadth, the extent to which 4a- test Js defined by. a specific 
a educational Program, the recency. of "the learning sampled, and the ourpose. of 
_the-test. The authors then continue, “The dimensional analysis is .useful. in 
ie anicating why there is ‘contusion Concerning the proper category int which: toy. z 


ce ‘certain: tests: Just because. differencss, among test™ ‘items are _quantitative’ : 
not * qualitative, it is possible for one man ‘s. ‘intelligence test 10 ne secre, 


‘ were . used ° in the iowas Tests. of Educational Develormment for ‘assessing. 


. achievement. “(p. 21): eos : cae : aS 


Definition of Test Validity ee ae a es a : 
‘one, man’s inteltigance test can n be another man’s achievers ne 


a The: general ip nae smocdel. assumes hue “intelligence” is an. 
_atygibure ‘of “the person. It cannot be’ “measured directly bécause current’ ag 
z functioning ‘reflects some combination of the: person's biological andowment: and 
the ‘person's cultural: exposure ‘to the materials in. the rest... Therefore, the ws 
individual's “Snteiligence’’ has >to be inferred using the | inferential model | 
, described earlier in this paper. This model is essentially statistical. The validity of 
ry particular inference within the’ general intelligence modei is determined ‘by the 
extent to which the. procedures used to -make: an inference about - the. , 
; “iatelligence’’ Or: “earning: ‘potential’ ofa: Particular, ‘person meet: the reqttires 
ments. of the inferential - paradigm en which: ‘such conclusions: are based: tf the 
“person: i5 being corhnared with oners who | have “nad the same opportunity to. 
ae learn the materials in the test, have’ been similarly motivated , to learn those 
“> matarials,: Rave nad sirniiar. test taking experience, are equal with respect to. 
" ematicnai disturbance, anxiejy, and ‘physical disability, then the procedures. : 

> meet: the assumptions of the inferential model and are “vatid”. tf any. or: alr “Ofge 
the above conditions _ are not equal, then, the prceedlatas do not moet the 
: > assumptions of the inferential model and are “invalid. "Thus, ‘the. requirements: 
ae ake OF the inferent ial: <nodel for i potential” ‘encompass the issues 


yckarourds =, oa. et at ; eee 


Validity agile thie general in talligence model does not relate to predicting some ; 
criterion performance, Criterion related validhity appropriate’ within tha social 
< adaptivity, model. V Wechsler all alludes to Se Saucon wre he declares “that "1 
attempt has been made to define a priori the sccial and chnica! significance si ; . 
any given 10’*> sather, intelligence “ig something that is inferred from the way 4 
thase abilities are manifested under different conditions and circumstances.-One ‘ 
a can infer an individuai’s intelligence from how he thinks, taiks, Ynoves. alrnost Bets 
{rg any of- the many ways he reacts 19 stimuli of one kind or another. 
(Wechsler, 1974, pp. 3:-- 7). In actual practice, it has- been the logic of the- 
inferential paradigm rather than some. tyne of criterion related validity which 
“has ‘operated in clinical assessments. It is significant that during the testimony in. 
Larry P. v Wilson Riles only one study could be found in which an individually 


Paster against a 5 off rect measure of social system Gartotmance ‘such. as ‘grades 7 
~earnied. ain academic subjects . or teacher ratings of academic ‘performance: | 
Apparent 1, the” validity of. using ‘a test for the: purpose of-inferring. “jntelli- - 
: “gence” ‘has, in fact, rested on. the logic of the inferential partion rather than 
oy aemnplcigal: evidence af Predictive validity. a ? ees SON er 


‘Racial anf Cultural Discriminagion a we rs 
Charges. | that tests are. racially ‘and culturally discriminatory have. been focused on 
“primarily” oP. the’ interpr tation” ‘of tests within the ‘general intelligence. model. * oe 
’ (Bernal, 1975%.dackson 1975: ‘Williams, 1975). The definition of a sacially sand : 
culturally atiScriminatdry test within. the. general intelligence model differs - a 
markedly i from that. within the sooial adaptivity odek: “It relates to.: rthe % 
ts ASSUMPIONS , of the inferential baradigm whigh.must. be: “met. before ene i 
“can, legitimately be made about ‘a chitd’s*. “iritelligence.”’ . Fundamentally: : 
] argument. is that. children from. those racial sand cultural groups which He not A 
_. fully share in the dominant Anglo core culturaof American sotiety do not have , |” 
i the. same: opportunities to learn the materials: in “the tests, ‘the same-motivation to 
learn. the materials in the rests, nor ‘the: same test-taking « “experience as the: 
children. from the core. “culture, with. whom they are being compared. Therefore,~ 
no inferences - can be made about their “intelligence” by ‘comparing their” 
; ‘performance. on the tests with that of children who have had greater exposure to, 
“the culture from which the rest items ate drawn. Si nce the assumptions of the 
inferential model are not “met, the tests are “biased for making inferences about 
‘the mental ‘Capacity intelligence,” or learning potential of nan-Angio children 


he 


- Thus, the definition of test “bias in the general intelligence model corresponds: 
Closely to the dictionary definition of the term “bwas, which means to ‘show 
partiality, to favor unfairly, or to make inequitable <ombarisork | (Webster’ S . 
1966). In the general intelligence model; a test is biased if it shows partiality to += 
‘one group by inéluding mainly questions from their cultural heritage and fow, if 
Sa any, questions fromm the cultural heritage of other groups and thea makes | 
_ inequitable inference’ about the “intelligence” of the groubs on the basis of 
their responses to the quesnons. 


+ 3 


: rive major lines_of evidence: ‘are used to establish t} the cultural bias a & test’ in this 
& model. ae 


: “questions, the, test. ‘language, “and the nein ance: senected: oe "Shiledien 
’ fepresent asingle cultural heritage, this fact is taken as evidence that the test is 
biased (Mercer, 1975; Jackson, 1975, Williams, 1975). 


-. 2) ‘Ditletentes in Average Scores. Differences i the average scores of differant - 
- tacial and cultural groups on the test are further evidence within. the general 


intelligence qodel that: a test | is. biased... Differences’ which are large. and 
“. statistically kignificant ‘indicate that the two groups come * from different 
populations and that the groups . (a) should. not be ogmibined for purposes of 

establishing a joint-norm:. and: {by the norms “éstablished on gne group are. not 1h 
“appropriate for making : inferences about, the ° “intelligence” of the other group 
- ase a gt 


’ 


Mt should be ‘nated that in the: egeneral intelligenc modeRuitferences | in average | 

* scores jon. the test™ are cited as evidence “of ‘test bias. In the’ sdcial adaptivity, 
model,.the: psychorhetric definition of: btas® ‘which is’ ‘appropriate to the model — 
states that: differences in, average stores | are. irrelevant to the question of biasso . 
“tong as the: predictions made Atom tke test. are unbiased. The social encate ” 
model is ‘concerned. with bias in predicting future: performance, ‘while the general” 
“intelligence made! As “concerned with bias in making, inferences about general sO 
intetligerice... The: pu ses of the two models are different, ‘and the definition: Of a 
= what ‘constitutes a racially me aa A ¥ discriminatory test is different for. éach st 
model. woke ge 8 . “ . 


Me 8) Heterogeneity | of Minority Populations. Minority groups in the United States 
scare internally very ‘heterogeneous. Some |: ‘members of. minority groups are’. 

structurally and culturally integrated inta: the Anglo- -Americarweore: culture. 

“Other members of minority groups are bicultural, participating partially. inthe 

Anglo” core culture and partially, in “theie non-Anglo tradition. Stil other 

members, of minority groups are completély , outside. the Anglo core culture. 

They may be.recent migrants to the United. States or mernbers of groups, such as 

some native American tribes, whe have. insulated themselves from, the dominant 

Anglo culture. In either case, children reared i in such ‘Non Andlicied settings may 

Hot speak the English language and “may know hittie or nothing about the 

American core culture. Ht can be demonstrated that those minority children ‘who. 

_ are Fae in families which’ are structuraily and culturally integrated into the. 
core culture perform better’ on tests of “general intelligence,’ such’ as the . 
 WISC-R, than children who are from bicultural backgrounds. Children from 

‘sbicultural backgrounds perform better on such tests than those from families 
“who are completely outside the Anglo core culture. Differences are systematic 

: “and tinear. "The average scores increase progressively as the children in a 

Toe particular group are™ froin” ‘Hore ANgigized” “Backgrounds: The range” “of megan ™ 

a scores is approximately 15 points. (Mercer, 1973). The finding that the average 
test scores on the Wechsler scales for minority children increase progressively as. ae 
the families of the children are more acculturated to the Anglo core culture is 2 
“presented .as one line of evidence that the tests are sansitive to cultural 
differences and systematically discriminate against children from non-Anglicized 
backgrounds. Therefore, it is argued that.such tests cannot be used ta make 

3 LEREENGES about general intelligence when testing minority children. 


eee? (4) Experimental Studies: A fourth tine of evidence for cultural bias,, when 
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making | inferences within the general intelligence model, -comes from studies : 

~ whigh’ ‘demonstrate: that minority infants: ‘who. are involvedy with their ‘mothers, 

in socialization” programs .which. increase their exposure. to the language and = 

practices of the dominant Anglo core culture. ‘perform significantly better on. - ey 

~ “intelligence”’ tests than comparable infants who have'not been involved in such: 
interventions. ‘Dit ferences: as large as 33 points have been reported (Garber, 
1975): . ee. 


= , 


= 


Ma tS 


(5) Minority Chitdren Adopted into Core Culture Homes. Findings agi minority 
ball aden adopted: Into middle class” Anglo ‘homes do significantly better. than | 
“their counterparts who were not expoged to the dominant culture through 
7 ‘adloption: ‘provide-a fifth line of evidence for cuttural bias i in making infererices” 


concemi ng qeneral imetigenee fram. test per formance (Scarr cand ‘Weinberg, 
«PED ~ . «ORS 


— 
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Prick for. ‘El invinating Raci taf ane Cultural Discritnination es General. - 
intelligence Model. . t ia 
A. campiete discus: sion of the. yan ety ee proposals which. Rave been made: to: 
correct ‘for the cult tural bias im tests is beyond: the scope of. this paper. Two 
~general approaches h ave been proposed: developing, new ‘tests. and, modifying , 
existing test 8 a: ~ 


6 
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Developing New Tests.- ; : 
a“ "~The search for the “culturs-Free”’ “tat was based: an the ass “umption that itis ta 
A possible to develap a. test consisting, oF items which are "free" of. ali-culturai 
 intluence. Efforts in this direction have ‘bgen unoroductive since all learning 
takes place’ in a socio-cultural seting and all tests sneasure te earned behavior” 
Westman {1968} and Williams {1975} both agree that the search ‘tor the 
; culture: free test is futile, ; — 


pa a ‘ > : ve che 


, (2) The vculturefaic’ test has been Parsued along two ines: the ‘common: 
_ culture approach and the. balancing items, approach. The coramon-culture 
> approach assumes that there ar@&tasks ar: problems which’ are common to all 

_ cultures and that a test can be developed using only such items. “'To be equally 
fair to al! persons, an intelligence test should present prohlemns that are equally & 

- ——————Famitiar-or-equatty-unt farnitiar- to-all—-(Eelisnet-ak- POG} To t6i- However> Davis 

JF and Eells were unsuccessful in achieving cultuse-fairness with. the common: — “ 

. culture approach based on a series of-“games’’ {Cranbath, 1975). Research on 
the -culture fairness’ of Cattell’s Cuture-Fair Tests for Measuring Intelligence 
(Institute for Personality and Ability Testing, 1973}:i5 limited and inconclusive, 
Some investigators have attempted to use Raven's Progressive Matrices (Raven, 

4960). and the Goodenough Draw-A- Man Test (Harris, 19623) for occa . 

assessment on the assumption that the tasks required | in these measures are 
common to ail cultures. However, differences in average’ groun performance 

“parsist (Dennis, 1966: Irvine, 1966). The psycho-situational CONERE of the 
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ne testing situation presents numerous complexities in communication which make 
“it difficult to interpret’ perforrnance cross cultural (Mehan, 1973: Roth, 1974: 
: MacKay, 1974; and Bersoff, 1973). Other investigators have proposed ' develop- _ 
: ing: ‘culture: fair measures by including arr equal humber of items from each ofthe 
cultural. traditions of persons taking the test. For example, ‘a test designed for 
: Hispanic, black, and white chi dren wourd incliide.a thire of the items from the> 
; “Hispanic culture, a third of the iterhs. from the black culture, and a third of the. . 
“items: from: the. Anglo core cultuine:: Breland, et al. (1974) has’ questioned the 
cross-cultural Stability .o of test” items. ‘hn addition, the political feasibility of os 
quiring ‘children from: the politically dominant’ ‘group to. “respond” to questions. sas oes 
from a maInonyy culture: is questionable. ° : sl 


Pa as 


rues 
on 


£3) “The 5 . culture: “specific” test “hay also’. been proposed, The: BITCH. 100, 
. developed by Wi iliiams i 1975) isvan. example of a test designed thr persons: ‘from a | 
minority culture. The. primary difficulty with this: approach is the tremendous. : oe 
cost of prothi¢ing a-large variety. of tests, ane for each sub-grouD: within: each 
“s, athnic group, No single test would be. appropriate for all black children because” 
4 their cultural backgrounds: range from the peasant background of the rural south : 
tg the middle-class professional! family: No single. rest would be appropriate ‘for ae 
a - all Bienen ic children, and so forth. _ ‘ 


ai 


(a) can investigators have hypothesized that he developmental. a ages 
> deseribed by Piaget cout provide a a CrO@S -cultural framework for assessment. De 
Avila and Havassy (1975), have developed test instruments for this BuO 


. Moditying Existing Tests i 
(1) The translation of existing Lats into languages oth than “Engiish has been 
-. atternpted as al means af controling for the inappropriateness af.an, English .. 
_ language . test, when assessing a non: English, speaking. child. However.” “direct 
translation of vocabulary ttems is “frequently not possible. Translation , also 
changes the: difficulty lever of items: because those words which are used 
‘frequenthy in “one language system and.hence have a lower difficulty level may 
not be used’ as Frequently in another language: system, The content of the items 
- rernains culture specif IC. Smith (1974) studied fourteen dif ferent versions of the — 
P Binet, revised for ‘nine countries from 1908 to 1960. and. concluded that each 
“Binet iter Hada different cultura’ yoadiag which was bound” toa “partivielar time 
and locate. Studies of Spanish translations af the Wechsler scales report: ‘similar. : 
difficulties (Moran, 1962: Coyle, 1965). If:a test is ‘translated, then the item _ Be 
difficulties will need ta he recalculated: the item. content should. be changed to. - 
“reflect. the cultural milieu ‘of the new fanguage: system, ‘and the test would need 
to be ré-normed on the population for-which it is to be used. In shart, a° 
translated test ‘is essentially - a new instrument and must be restructured and 
standardized. : syeanagensaed eee oe 4 


{2} Changing phe procedures for administering the test is another modification, 


aa : eee : : a = . es 


: whit has: ene aed Pome “examiners have: “varied the speed and power _ 
components of” the test based on the assumption that. given adequate time, 
% persons from differing cultural background will perform ina similar fashion. 
Schwarz (1963): contends" that there, are. unpredictable complexities when ‘the. 
speed: ‘power factor. i$ varied in test administration. “Changing the wording of 
~ “questions, praviding additional cues, changing the scoring procedures, and other 
oe ~ modifications, inthe standardized administration procedures.make ‘it impossible ~ *A 5 
to interpret. the scores within’ any existing normative “framework. A new norming | 
of. ‘the test based on the. modified procedures i iS required betore scores can be. 
interpreted, Gast, 8 re: ; 


“4g ‘A test-train- -retest-patadigmn pa been proposed: ce Budoff. 972)" using. © 

- nonverba! reasoning tasks such as those in Raven 's Progressive Matrices: He * 

sinterprets the. gain score resulting from teaching as a meastire of the chifa’s — 
“tearning potential.” Although’ this is. a promising technique, there are. 
difficulties | in “standardizing | ‘the “training” phase of the sassessmeng arid it isa 
lengthy procedure ey renee contact hve : 


War ats co tee 
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7 (4). Devsloping sociocultural norms for each sociocultural group within an ethnic a * 
: group is another approach to achieving non- discriminatory - ‘assessment using 
”S presently available” mepsures: (Mercer and - Lewis, 1978). The System of 
-Multicultural Pluralisti Assessment iSOMPA) provides a procedure in which the 
average score fora chid' s sociocultural group is calculated: using four measures 
of the child’s backgroung: Urban Acculturation, Sacioeconomic Status, Family 
Size, and Family Structur& The child's score is-then compared to the norm for 
his or her sociocultural group to. determine how high or low the child's - 
performance is when compared with others who Presumably ‘have hach similar 
“opportunities” to learnthe materials in the test, The comparison is converted to a 
metric which has a mean of 100 and a standard deviation of 15 tor more ready: 
ifterpretation and is talled “Estimated Learning _ Potential.” The SOMPA 
: approach. has the advantage of. being inexpensive tcalculations take about 3 
, minutes), feasible {the multiple ragression equations are available for Hispanic, 
black |: and Anglo ch: Idren and: are relatively easy to develop for other groups), | 
_ and do, not require extensive re- training of existing personnel. Distributions of 
scores on Estimatedearning Potential are completely normalized for ffi groups. 
en that. each group. -has_a. mean. ~of.. 100. and..g.standard.deviation- of-15 and 
approximately the same | Percentage - of chiidren <n the two tals of the ‘ 
distribution. ‘When this procedure is used, the test content, .orocedures, and 
scoring are. not altered in any way, Only the interpretative frarmework, the 
: Roney are varied to reflect the appropriate comparison group foreach child. 
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Diagnostic Values wi ‘thin the General, Intelligence Model. 

The diagnostic values appropriate to the general intelligence model are similar to 
those governing | the social adaptivity madel. tn each case, diagnostic labels can 
trigger .either Positive or negative. institutional TeSponees which, in- “turn, may, 


“propel & a rohild into. esteahed or disesteemed statuses, -as. . the case may be, Just as -: 
; the “deviance | process tends to culminate in: the. Psychic Testructuring of the, : = M 

individual : in terms. of the deviant Status and role,” so institutional processes 3 
Swhi¢h. move .the .child . into esteemed. ‘Statuses associated “with . enhanced > 
“opportunities: tend to culminate in the ‘psychic restructuring of the child i in terms 
of. the ‘valued status: and role, ‘Hence, overestimating a chiles Jearnihg poteritial - ae 
. ‘or “intelligence is -a legs - “Serious - errdr. than underestimating a child’s: learning . ae at 
pono because the cOhsequences of the: former error are’ kély to be.positive, — 
rite those resulting. from the latter errot are likely: to. ‘be Regative. = 


, 


= 
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"e “Having identified ‘some of “the: ufqué charsduetticawot each “of the three 

, assessment models used by pérsons making assessments of children, the. next ‘task. 7 
sis to discuss hew’ the three models can.be integrated into an overall” design for 

: “racially anda. eniturally nondiscriminatory: assessment. “A set of concepts first. > 
introduced. by: Cromwell, Blashfield, and. Strauss (1975) will be.used as. the... 
“framework, for the toltowing discussion They. presented a set of criteria for a 
logical. classification system which Femdbaized linkages between etiology, 
_ diagnosis, treatment, and prognosis. Although their interest, was primakity from a> 
medical perspective, the framework is useful in conceptualizing the assessment 
process in i ‘educati ion. ; - of. 


ah. nee, 


>a Building Diagnostit Constructs 
, “in ‘Educational Assessment = : 
Cromwell and his: assocpates (1975) dae four major components in a 
= complete diagnostic construct and gave them alphabetic: designations, Two 
additional components have been added to” include both the “preplacement”’ 
. evaluation and the reevaluation. In. the agsessment. process, a diagnostic construct © 
is created by operationalizing each, :comporient, one 2 presents a pictoriai a 
__—_Leprasentation of: re: builcling-of- diagnostic constructsy ~ et 
S sy : « 7 a a N we #3 
A, ‘Historical and E tiological infarmation. Component A consists of information 
about the child's developmental. history, health history, and family background 
which may be useful in tracking possible sources of current difficulties: 
‘Ordinarily, the more complete the historical. and etiological information, the - 
more> precise - and -comprehensive the understanding of ‘the child’s current 
- characteristic’, All three assessment models provide Tyee A informati rons 
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> BL ‘Currently Assessable Characteristics (Time WW. ies B consrsts of all * 
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_ * . ae . - : _ > fo , -” . F ‘ * > ¢ 
oe MT SIX COMPONENTS OF A DIAGNOSTIC CONSTRUCT 
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te “information about the’ child’ $ current characteristics which can be assessed 
and is. relevant to developing a an uBderstanding of the situation at the time of the 

. initial assessment, Time’ 1. “Agait @ a three assessment models: can, provide Type aoe 
& jnformanoa. a ase, 3 00 Poa 


- \ ‘ 
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eh Prognosis without jacervennen. Component c|n nas. been. sas tox tHe . 
- Cromwell. (1975) framework. dt consists of UAB Drognostic statement based on. 
* the ‘Type. A and 8. information. which presents” the probable outcome if there i is 
é tion of any kind: If the conclusion is that ‘the prognosis is favorable 
tervention, .theni:the building of the diagnostic construct would be : 4 
= terminated cat this point in the assessment process.- Vf: ‘on the other, hand): the 
prognostic conclusion ts, hat outcomes will: be negative” if there iss no 
intervention, the diagnostic process “Moves to DL ; , 


. 8 


“D. Pioposéd jatervention® individual EducationelPlen: Cxnnonecr: Dis is: the: plan - 

. for the interveagion « -which is developed on the basis of the: ‘information: provided 
_ in ‘components. A and” B, Proposed interventi ons. will: inchude treatments for 
“identi tied organic problems, such as. glasses to cotrect~ for visual itipairment, 
2 _ hearing ‘aids: to Correct for audftory 1 impairment, physical therapy. to ameliorate. 
“physical disabilities: and, so-. forth: ‘Interventions also. ‘include .educationa 
" procedures :to assist the child: in. mastering ‘the curr rculum, of the school and Oe 
ae ‘the chiid achieve an adaptive fit in those systems in which the child, ‘May be. 
Raving difficulty, such as the -peer group, the community, the school, and ‘$0 . 
forth. The specif c mature of these i interventions is, deter: ined by the unique 
‘needs “of ‘each “child” as. revealed in “Components A and B and Constitutes on 
IndividualeEducationa! Plan. . fo wre 


Se 


E, Prognosis with Intervent: on. Component E¢ CONSISTS of the niegneee made by” 
the assessment team ‘of the-probable outcome of the proposed interventions. 
“This prognosis is: developed asa series of speci fic objectives Stated in .terms of a 
series of Uma fines” The objectives inciude. those ‘relating. to interventions: 
~ directed at. correcting or _amehgrating biologica! problems, those _telating to 
‘interventions directed at educagiinal needs, and those relating to achieving an * 
adaptive fit in the various social systems, in Which theschild must operate, Thus, 
i Component E provides the basis far monitor! ng the progress of the child’ in : 
response: one “proposed treatment-by specifying Drecisely what objectives ara : 
7 10 be met in + each area of identified need by a particular tine. The agreed-on 5 3 
time ‘frame provides. tne time schedule for reevaluation to determine if the 
interventions, are effective. The statement of objectives. frovides the array” of 
: assessments which will be made at the: time ot the reevaluation. 


Pe e - 


JF Reevaluation: Currently Assessable - Characteristics, Fine 2. Reevaluation 
“stakes place’ at the time agreed on in the ies eee Plan. It covers the 
array of ‘assessable characteristics which were iffrporated in the indlivieluat 
: Educational Plan as -targets for intervention. Based on the findings | of - 


* 


ee 7p eects Ly 
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= “Component é, the diagnostic. process “recycles to Component C. “Again, “the 
assessment: “team” estimates the probable outcome if there is no. further ©. 
: intervention. lf the'de sion. is that the outcomes will probably be positive, then | 
= “igtterventions may. 3 e terminated. Af, the: decision ‘is. that. the. outcomes’ wilt: 
probably be, ‘negative? ‘then’ the process moves to ‘Component D. “An updated>> 
* Individual Educational” Plan “is ‘developed based. on the ‘child's assessable 
oS ‘characteristeics at ‘Time 2 and a new prognostic statement, -Component E, 

; _ developed. “The reevaluations and the recycling of: the. assessment pimcadites 
. continue, as pei * the. assessment team concludes that interventions are ‘needed. 


; Partial Diagnostic Constructs 
“ Wher: the schema sunicie: in Figure 2. 18 used to y avaluate the assessment process . 
in a particular. educational: institution or school district, it Can. identity missing 
‘components.- ‘in local assessment practices: “Some pa tial.diagnostic constructs are. 
“useful in spite of the fact that they are incomple “while other partial diagnostic . 
= “constructs are either: useless to educators gr invalid. The Primary types of partial. 
“ diagnost C constructs will. be discusséd briefly... . : 


’ 
Sea. . 


: “ACDE and” ‘BCDE conseruets ~ are” tn everi ‘though: ae are “pied: on’ 
“cincomplete-information*, ‘The ACDE construct includes no information on the 
 gurrent “characteristics © of the child, ‘and. the BCDE construct includes no- 
bs information. on the history. etiology, or family background of the child, In some. 
. circumstances, it may be, possible to arrive. at a prognosis without intervention’ 
_. (C), develoo an individual plan (D): and make ’@ prognosis'with intervention (EB) ~ 
on. ‘the basis of incomplete information, but stich cases would be limited to those» 
—> in which the child's problems were quite ‘specific; such as a visual impairmant | a 
“ a with Rac a minor articulation problem, and $a. forth, 


+ 


». 


7 ABC, AC. BC a are. “those rare. instances in: which A. ‘and/or 8. 
information Provides the basis for:making a prognosis, ‘put there are na "known 
‘treatments for the- child’ $ problem, Hence, ‘the diagnostic construct stops after 
the prognosis without intervention because. there is no ‘known intervention. for 
the child's disabilties. Fortunately, with. improved medical and educational : 
~——~rechnalogy -there= are-relatively: few: circumstances: ‘in-which-a- child- -cannpt~be- igen ee 
ar helped t to some extent by some type of medical or educational intervention. ee ts 


DE constructs are quite common. ‘in education: They occur when d an: Jinterven- a 
, -tion, such as a ‘reading program or mathematics program, is poe A a group ia 
y ‘of ‘children; irrespective of their ‘individual characteristics and without Type Aor. 
B. inférmation. A generalized. prognosis is mace ‘that those receiving the Program “ 
will reach some educational objective’ Such constructs may be defensible in 
- planning educational. programs for children who’ have no special educational ees 
* needs, however, they. are not defensible in planning an educational program for. . toe 


“handicapped” children. Public. Law = ™_ is s quite ‘Specific on this: point. » 


“AB type. constructs ‘are oe to the scholar and academician ai is trying: to” 
track felationships between historical or: family. background” factors. (Type. A. 


not eon). “to. “any prognostic’ ‘staternent or to any. known intervention: For 
- exarriple.. it may be interesting to. know that childr. nl who come from: Aarge 
families : (Type A information) tend: to do: less-wellon ‘tests of..academic - 

chievement | (Type- B information), but. this knowledge cannot utilized 
; direct iby the school: ‘in. planning for the individual child. 


s ABCD” ‘SACD, BCD’ are invalid’ . They joclade'a an intervention (the D. 
, “component) for wh i NO ‘known outcome and hence. no statement of 
the prognosis with intervention can be made s.Any educational intervention, 
a therapy’. or program which is instituted: without Knowledge that it is efficacious . 


Saree would “qualify asan invalid construct. Tee Soe sa 
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Building Diagnostic Canad : : 
= “Using the Three Assessment Models . 


* 


¢ 
be 


AS noted. earlier in this, paver, Public Law. 94- 142 and the fsdoal: guidelines. “ 
oe relating to that statute list a large number -of Measurements which’ are “to be 
“included inva raultidimensional assessment. Some of these measures fit: the 
‘medical assessment model, such as measures of health, vision, hearing, motor 

“Sgbilities, and physical condition. Other proposed? measures fit. the social = 

~ adaptivity, of social aa model, such. as measures ‘of academic performance, ‘ at 

"teacher recommendations, “communicative status,’and adaptive- behavior. Still io 
‘others “relate to’ “the measurement of, “general intelligence,” an’ "inferential - . 

“. pr roctBure whi ch belong: in ane general imteligence or ee Y. 


: Each of these models provides: information Weich: can be used at each Stage bk. 
: - building a ‘diagnostic consttuct:for the individual, “child. Figure. 3 presents .a” : 
schematic, -reoresentation of ‘the major types of input provided by. each ofthe Lo 
assessment models at lal stage in eee a diaanostic construct. ; 


ae: 


“Medical Model Measures. ¥ 
There are three’ types of measures “within the medical model which provide | 
: oa Component” A information: the health history, the medical history,. ‘and ‘the 
_-developnrental histofy. ‘Ordinarily, information on the chealth history and the. 
“ae developmental history°comes from the mother or-other principal carétaker. The 

” medical history will come from medical records kept by individuat phyaeians,, 

clinics. hospitals: or other health service institutions, 

“There are numerous types of medical model intormetind which contribute tor 

* Component B. Tests of. chysical coordination or dexterity. tests of sensorimotor: 
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‘Soctat Adaptivity:o or Sacial System Mode! 2 sett ee 
Histori 1a behavioral information (( nporient Ai is jeseuently avaitable tor: the 
thild: who - has: attended the, school or. a period. of: years. Such . information. 
‘bgcomes part. of the assessment proce providing. background information’ ‘on; 
a Cthe e child ‘S earlier performance ont § designed to-measure behavioral variables. 
‘Agmentioned, earlier, there are two types ‘ot behavioral measures generally, used 
“im othe» -schools:. psychometric and: “edumetric. “Figure’ Tists> ‘two. types. of. 
sychdmetric: measures mentioned. in the quidelines. for: Public” ‘Law 94. yagre' 
* rmieasures,. of ‘adaptive behavior and. measures. ‘of. academic. achievement... In 
- general, measures of adaptive; behavior : ‘evaluate. the child’ s adaptive. fit in: a 
oS wariety. of ‘social systems: the . family, the ‘peer,- group. the. community, - 


“economy, the’. school, and 50. forth (Mercer, 1977), Measures: of ae 
5 cachievement.. focus exélubively: on the child's skills in fulfiting me academic | 
xpectations of ne student rate in the public school. 


4p, addition,” re guides ior Public - “Qa. jaz. mention:. “two * types of 
édumetric. measures: “teagher’ $ recommendations” and measures - of academic. 

performance, présumably measur es. more closely related. to the curriculum of the 
“schoo! than thes ‘typical standardized. achievement. test, There are. numerous 

~ forms. mn. which | ‘teachers, can “provide edumetric information about the child’ =. 
_ behavior which can be useful” in orogram planning: teachers’ referral in forrta- 

; “tion, “Arades, | “checklist, ratings of student's “performance. ‘abservations, and 
anecdotal information. A wide variety. of edumetric tests has been Goa 
during g the | past. “decade; Tbutit ita ‘is. ‘beyond the scope. of this this paper. to ) discuss these 
‘in any detail. Such LESts are “used to assess the academic ‘skill development. of the . 

; child | in specific. acatiemic areas. tt, is assumed “that the development of more — : 

omplex skills: iS coritingent. on, mastery ‘of: lower-level sk: Hs: Such measures Bre 
“subject: -matier referenced: ‘The specific skills orbehaviors deemed. to bei important 

are. determined “by. the goals, values! and objectives: of the educational system, ve 

and: “skill development: is: influenced by. sociocultural” background. “Hence, 2: 
edumetric ‘measures designed for’ ‘task. analysis." talone within the’ framework of... 


‘the. “preplacement’: “or. “initial evaludtion: at the. child, hineeieal information 

the child’ 5 behavior as assessed on psychometric and. edumetric measures may 

; may. not: be available. in either’ case, a full array” “of both pychometric and © 
edumetric information should be gathered: at the time of ing evaluation ee 


The. Vv lidity: of sie measures. is determined byt their ability “A etlect accurately: : 
8° “degree to ‘which’ the: “child:i is making” an adaptive’ fit. to. the: behavioral : 
expectations of the: role being. evaluated. “HE, the behavioral: “measure: purports, tos 
assess: the. ‘child's: performance in the peer: ‘group, the validity of the: measure is 
et mined: by" ‘the power: of: the: score to" accurately ’ “reflect the extent: to “which 
~the: child’ $ “performance is: acceptable: ‘to the peer group. If the measure purports . 
Sto evaluate ‘the child’ s performance in the family,” its validity: is determined by. 
the: accuracy with “which - it: captures: the family’ s perception ‘of “the child’s 
“performance, Mf the measure purports to assess the child’ $ “adaptive fit, to the: role | 
of: student; its: ‘validity As. determined : by: how. well scores. on. the instrument. 
‘correspond with. ‘teacher. ‘assessment. of the child’s performance, The individual 
doing the assessment may: or may ‘not vagree.with the ‘behavioral standards of the . 
‘peer. group, the” family, or the ‘teacher. Such agreemerit is not necessary, so. long = 
$s the. measure accurately measures the adaptive fit: of the child in the system, . 
whatever. its, norms. : > : 


The: reliability of the direct measures : “ot performance i in the. social system i iuew: Ce 

: . teacher” ratings,. peer ratings, etc. is. determined ‘by inter- rater, ‘neliability: ‘when. 
ster fom two different informants from within. the systern-a are correlated: 
The: definition of test: “bias” which is, s, appropriate within this model . ‘is that 
_ propounded by Cleary et al. (1.975). If the percent redkwetion in error, slope of . 
othe regression lines, and: intercepts of the regression lines are similar for two... 
“racially or culturally, different: groups, then the measure ‘is making racially. and . 
culturally nondiscriminatory’ predictions. If, ‘however, any one. of ‘the ‘three *: 

“criteria are’.not met, ‘predictions. will be, discriminatory, -The., direction of the 
discrimination will vary, depending: on the specific relationships between the ~ 
correlation coefficients, slopes of the regression lines, and intercepts of the >. 
Regression lines in the particular case. ee. 


itis: usefutsin- this-c ontext: “to differentiate betiveen"direct’ and-iidirect mieasires™ cuteaee 
of role performance. Direct: measures of role performance would be evaluations 
“of the. individual's. role. performance by other members of the group. indirect. 

Measures of role. performance: would be measures based’ on: information from | 

ormeone who: is nor. a member of ‘a group but an “observer, “measures: ‘based on 
self-reports: and. measures. -based- on oBservations by.a nonmember of the group. 
So For. example, sociometric ratings campleted by ‘members of the peer gang would: 
., bea direct measure ‘of the extent to which a child was performing in a manner 
a acceptable to the group. “Intormation* from: a mothes or a teacher on the child’s 
: - adaptive fit to the: peer getup would be an. cindirect measrue. A. sender € erating of. 


be: a Grea ‘measure. of “athe child's role performance: in “the ‘classroom. an: 7 
academic. -acheivernent: test, an aptitude test, ‘the: parent’ s report ‘of the child ‘se 


performance. In: general, direct measures are ree as’ ve criteri against which: en: : 


ndirect measure is ‘validated. ° Academic. achievement and aptitude tests are - 


‘validated’ by correlating them with | teacher ratings or teacher Be oS 


The General Intelligence Model, caiovad information . ‘on the child’ 'S learnings 


po. ential “which is -useful. ‘primarily: in. making: prognostic’ Statements: “Compo: 


dents a6) and. E. Estimates ‘of the--child’s. “intelligence” can be made if the 
assumptions ‘of: ‘the. inferential: model: far making inferences about” “potential”.o fs 


“intelligence” “have: been met by: taking into account-the child's sociocultural 


background: and ‘the child's physical: disabilities through using: one: of the 
approaches * discussed’ in: Section. <2 of this paper. Prognostic | “Statements. in 

‘Component C, prognosis. without intervention, will -be more positive if the “ 
7 “child's estimated learning potential is high rather than low. Likewise, educational - *, 
“objectives. and. time jines’ for: ‘Component E will be modified, “up. or down, 


: depending. on estimates ot the child’ s penne potential. 


“tn order™ to make snferevicss about “general intelligence" which’ are not. Gacally . 
sor “culturally . discriminatory, itis necessary to take into: account the child’ s. 


sociocultural ~background and, the extent. to which: the standard: norms may. or. 


may not be. appropriate for estimating’ the: “potential of a particular child: 


information, on sociocultural background can also be used, independently, as a_ 


3 Source. -of Tyne A information, Knowledge. of the child’ sfamily background can 


‘be: ‘uted to. inform: the Assessment: tearn of the gap between the sociocultural: 


’ background of ‘the child: and the culture of the. school..Such information will. 


_Sagsist them in determining the magnitude of. the problem faced by the ‘Child: in 
‘« attempting to bridge that gap. It can also provide: cinsight into ‘possible. avenues, : 
or. assigting the ohitd: eTougty developing. cooperative arrangements with: the. 


fait: 
a The Assessment Team 


i In the guidatines and related documents for Public Law 94.142, two’ er a 


proposals .are made .to assure that assessment. data: is Mot’ misused ‘and 


misinterpreted: (1) tralning personnel-to use the tests in the manner intended: by 
the person who developed: the test and (2) placing: responsibility for: educational : 


cisions ina muiltidisciplinary planning conference. which will include "persons = 


knowledgeable about the child, ane meaning of the evaluation data, and ‘the 
_  Plagement options.” : 


+ 


- When® all ieee assesement models are used to develop diagnostic constructs, as 
“depicted in Figure 3, the planning conference or assessment tedin. must include 


"persons, from a satay of disciplines. An optimal eonliguiation: would include: = 
— the following persons, ; 
“Educational. psychologist or. school. psychologist. Ties person in this role : aX 
ee ‘be trained: in the administration of individual “intelligence” tests and. 
, _ would be responsible, for making inferences about ' ‘general intelligence” within 
-. the general intelligence or pluralistic model. He or she could be involved in: 
nt collecting and interpreting data weihin the Social Adaptivity” Assessment model. 
ae on 
Sn Speciat -ediucation personnel, “resource: teacher, educational “diagnostician.. : 
. The person in this role wouldebe one who thas been trained in administering and 
simterpreting edumetric tests and would have specific knowledge and expertise in > 
“developing Individual Educational Planse: : : 


whS wwss;, 


= . 
- 


a 3. School nurse. The medical model measures. ‘both Type A and, 8 information, 
“would be provided by the schoo! nurse’ screening for visual or ‘auditory 
‘impairments, sensorimotor skills, physical coordination, health histéry, and so. 

or forth. In addition, the- ‘school nurse “would be. _ responsible For medical . 
‘interpretation of the health: history-and. developmental histary, He or she mayor. 

ay np: be involved. in collecting the data for the health and Gevelopmental.. 7 
histories, : : : 4 
ae F eg , & : ety 
ea Schoo! social worker, counselor, or visiting teacher. The person in this role 
- would : be: responsible for famity contacts, Ordinarily this: individual would 
collect the data from the family on the child's. adaptive behavior in non- -schooi 

= settings, would collect data on the socio-cultural characteristics of the fam'y, 

i -and 30 forth. They." shoutd atso - be trained tov interpret adaptive . bebavior 
information from the family anc to work with the farnily in imolementing the 

Individual. Educational Plan. 
: = ; 7 ; 

5. Classroom: teacher. In addition to providing edumetric data on the child's 7 

~ performance: in. the classroom, * the teacher would. be direc tly involved in 

decisions: concerning the elements of the Individual” “Educational Plan for the : 

———ehildrand Proceudtes errs that plan. os ee os ae 


As 


eo ‘ ~, . 
Le actus Eases requiring -assessment-in- “specia al~areas, such~ AS ae 
audiometry, speech, or vision, specialists in the appropriate areas woutd be & 
added to the assessment:team. A physician. would be added when screening using 
medi odel measures indicates the need fora more thorough medical ae 


7. The child's parents and/or a community suse: pessoa from the ehid ‘5. 
family should participate by providing adaptive behavior information on the. 

> child’s. performance outside the schoo! arid. the chitd’s health and developmental 
history. They would also be. involved in decisions relating to the Indiviedual 
Educational Plan and its implementation. oS = > ; 


t 


= ‘8. ‘Whenever feasible, ing child should be included ir the assessment team. To. 
. the: ‘maxitmum extent possible, the child:should understand the nature of the. 

assessment process, should be informed of the findings, and should ics a party to 
: sthe decisions made concerning his or. rher educational future. 


_ CHAPTER 4: EVALUATION CRITERIA 
FOR PROTECTION IN ASSESSMENT 


7 “quate for. protection in assessment described. in this paper ‘can. be viewed at a 
two" levels: the’ ‘level ‘of the individual child being assessed” and the level of the > 


mS school. district or- other iurisdiction, If the level of the individual child is . 


a described, that data can be aggregated to produce an assessment atthe 
‘ institutional or district level. Each will. be treated ‘separately, . ; 


? 


Public t Paw a 142 suggests five major: abpioaches to protection in evaluation: 
“AN multidimensional assessment, (2)-determination: of the validity of measures 7 - 
“relative to the purposes for which they are being used, (3) using personnel. Res 
; trained to adminster and interpret measures in a manner congruent with the’. — 
8 intentions’ of - the- person or - persons ‘who: Meveloped . each measure, (a) ~ 
te determining whether the measure is racially or culturally disctinminatory:. and (5)~ 

the use of the rmultidlisciplinary tearn.- 


' Protection. i in nAsibeanans Procedures: 
a of Individual Chitd 


* Multidimensional Assessment. 


The first. stage: in ‘planning the assessment of a child is making a series of _ 


* decisions” _concernirg’s the scope. or. comprehensiveness | of the assessment 
- procedures required in a-particular case. Ultimately, the range of measures 
“secured must depend upon the professional judgement of the person in charge. of 
é “planning the assessment. In some cases only partial diagnostic constructs will be 
needed - to devise an appropriate intervention. In other cases, a complete 
diagnostic construct will be necessary . Following a are some. decision rules es which 


can be u used in “planning the scope.of a a particular assessment. 


“ay ts. ae evaluation a “preplacement” evaluation or a “re-evaluation”? A. 

: “re-evaluation” _ will ordinarily focus more. specifically on the educational, . 

~---behavioral ~and-medical objectives “outlined-in the-oxiginal JEP and the choice of Pas 
| L assessment instruments will be guided by those ey The range of measures 
sin the.original evaluation — called the “preplacement”’ evaluation in P.L. 94. 142 

an will be determined by” two major factors: the nature of the “presenting 

» Problem(s)” as described: by. the teacher, parent, or. other person who  wetetred a 


rs . > 


the child: “and the. restrictiveness of the “placement” or intervention contem- ae 
plated for the, child. 2. ; ae ar a 2 = 


(2) ‘Does the “presenting: eaeemiae as “described” in- the referial relate to 
“medical: model, social adaptivity model, or general intelligence model, eee 
“The” ‘assessment battery should include evaluation in: any or “all. of the three* 
lomains - covered by.the 3 models, if they- are mentioned as problem areas by . 
“persons, knowledgeable - about the <child. For example, if the “presenting. 
ig)" relate to ‘academic difficulty, then. edumetric measur: s based on the. 
“social system model are needed. If they relate to interpersonal relations with: 
: : peers, then: a measure of adaptive fit to “the pe r “group ‘based on the sqcial 
a system model is indicated. tf the ° ‘problem"” re tas: ‘to vision and/or. hearing” 
sin aie ‘motor coordination ete. then medical model measures. are necessary: 


(3) The’ ire ‘parameter to te considered in-deciding the ‘scope - of an: Ty 
assessment is the. restrictiveness of the contemplated intervention. The general 
‘decision: rule is that: the more restrictive the contemplated intervention. the more | 
combate the diagnostic ‘construct ‘must be which Supports that. intervention. 
“Operationally, we" can distinguish roughly 8 levels of ‘restrictiveness of > 
educational settings along. a continuum, , 3 : 


Level, : - Regular Casein hice vehi: Special Intervention by the. Classroom 
: "Teacher Only - —No Removal from Reguiar Class.) ‘ 
Level 2: Regular Classroom Assignment: Special intervention ‘by . Ancillary - 

_ personne! “such as tutors, resource teachers, specialty, etc. - ~ No 
“so. rerrfoval from regular classroom:, ate oy 
“Level pet Requiar Classroom Assignment: Special Intervention by ancillary _ 

personne! involving removal torn the ‘ragular classroom far 1 to ce 
_ hours per: ‘week. ; °. 0 
Level -4:- Regular Classtoom Assignment: Special intervention by ancillary . 
personnel or special echucation ‘speci ialists involving removal from ine 
frequiar elassroom for 9 to 15 hours per week. 
_ Level. Special Education Assignment: . Education primarily. ina spacial 

: education setting with some activities integrated with the regular 
Berean er, classroom, such as music, physical education, art, etc. 
~ Level 6: Specia! Education “Assignment: Completely self-contained educational 
a ~pragram located on tha. ‘regular ' ‘neighborhood”’ school campus. 

: Level ?: Special Education Assignment: Located in a separate school for special 
: : education. ; . ; 7 ; 
“Level 3 Placement i in an hist national Setting otitside the. community. 


% 


~ In general, interventions at Levels 1, 2, and 3 would not ordinarity require ° 
developing a complete diagnostic construct. ° Partial constructs involving Edu 

_ metric measures or “medical” type interventions (glasses, hearing. aide)-or short 
term minor interventions {as in the case Gf speech therapy for an articulation = 


a 


~ Problem) would sito these lower levels, 


- However: any intervention at bivab 4 or higher would be sufficiently Breve 
‘as. to require the development of a “complete diagnostic construct ABCDE. In 
completing the suggested forms for - evaluating. “whether <a. child has had ° 
. Protection in evaluation procedures, NR is ,a> code’ _which stands for ‘Not 
: Relevant. At indicates only a Level 1,2, or 3 intervention is contemplated and ° 
_ that Barticular. assessment is not mentioned in. the referral. For) any. evaluation in 
: which, the intervention goes beyond.. Level 3, af aspects: ‘of the Medical: Model; 
Sociat Adantivity Model,-and General Antelligence. Model: “should. -be measured, 


regardless of whether they are. 2 mentioned | in the initial ‘referral as problem areas, 
: ag Ss 


Valid ty of. Measures. ; : : 
“On. the: charts. for: reporti ng the quality of an individiat assessment in meeting - 
~ the criteria for protection in evaluation; each measure is rated for how well it has 
beerg ' ‘validated, " Since .the definition of validity’ ‘varies. with the assessment 
model, ‘the ‘rater must use the definition’ appropriate for each model. Four levels : 
-of rating are suggested: Well; alidated, sooednately. validated, poorly validated, 
~and not valid or invalid: 


Trainitig'o of pare . os 
~The Hest of measures can: be ‘invaliclated if they’ are improperly administered or 

; improverly interpreted. Thus, the rating. oF ‘the quatifications of the. person’ who" 
“administered, scored. and. interpreted the findings for a particular measure i$. an * 
important aspect of protection in assessment, Again four levels of rating. ‘are 
Suggested : Well trained according. to Procedures suggested by the: person or 

: “persons “wha developed the measure; Adequately trained: Poorly: trained: and 

2 Unteained, “The evaluation. of. training includes . a judgement: as to: -whether the | 
~ person. is interpreting scores ‘on the measure .in the. manger intended! by the 
, Person or..persons who developed the measure. If such i is aot the case, the rating — 

, would be ‘Poorly. trained” regardless of cece aly held or the source of the 

* “training. . = ee ; os . a 
E dence that the Moaciie Is Racially and Culturally Non- Discriminatory. 
. Since each assessment. model has a different definition of what is “racially and 
< pilhieall nani inated: -and.-how..that-parameter-ig-to- -be~- teste within=————— 
each model,-the person making the judgement on whether a particular measure is- _ 

“non- -discriminatory” will - have to. be familiar with the: ‘definitions and tests - a 

‘appropriate to each model; Again, four levels of judgement are’ suggested. ranging ° 
“from Well Docurnented, Adequately Documented.. Poorly Documented, to No: 
“Documentation The type of documentation needed wil vary with each model, 


a 


* Multidisciplinary Assessment Team. . : 
The rating for the muitidisciplinary eam as based on the assumption that ; 
involvement at the level of both data collection and spterpretatian is the’ highest e 


_ level of involvernent. For ‘example, a social Wind e might. be. used to collect 
- family interview data but not participate on the assessment team or- be asked to 
“interpret the: ‘interview data.. This relationship ‘would indicate a° lower devel’ of P ges 
: “contribution ‘than’ if the social worker not. only collected ‘family data but’ 
._> interpreted” it and participated | in -helping to develop thé IEP. Even the most 
» “minimal “assessment would involve the teacher, parent, and child at ‘some level. 
Therefore, the Not Relevant response is not applicable for. these persons “in rating 


how. imultidisciplinary the-assessment teamis. fe, 
ee one 


Oe eg Mae. gy es OE ae oe PTO Se deel ae 
‘Summasy Scoree : a fae, 
“Because some ‘types of evaluation may not be relevant for all childreni wn. average ~ - 
“score an the relevant ratings is used as the summary score rather than a simple 
> ‘total. Thus, the summary score consists of the total number of points given each _ 
: _ dimension measured summed: to “get an overalltotal. which is divided. by -the:: 
; io ad lala rated. The minimal criteria a a an “average rating of | 
~ 2F or Higher % aS : eo 


Phin! . 


4 In. sddition: “abe ratings given. individual ‘dimensions should, be sesininadl Any 
* rafings: of 0: ot ton any aspect of any measure makes the measure Suspect if Ce 
ome gure is poorly validated oF not ‘validated; issadministered ‘by poorly’ or 
: untrained personnel; or there is little or no documentation that it is racially or 
cultesally non-discriminatory; then that aspett. of the assessment process should 
: be repeated with different measures or better trained personrel, as the case 

sila be. a 2 “# ae . 


5 oe @ * 4 
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“4. Prysical Dexterity 


2 


Instructians for Completing Form: e 8 . ; Ne 


. Peron Was Din, 
~ Drenantinn Measared ‘| Name at tea | - Auminiseenag ‘Tasted? 3 


Visuat-Metot Coor, 


3. Visuat Acuity 


Relative Total = Tora fi 


S Total NR’ sb = Average Rating Pe 


Wat Dimension Teseed? Y= Yas = Nor Nf oS Not Aetevant, Not Relevant shouitlbe ¢ 


let Qos Ho the dim 


* mentioned as pare ot’ “prasen ag er BE 
“O° fae Nat Ariministaract’ 


iy Ba Levit, 


How Wail is Measure Validated? 3.= Well Validated ie. many intercorrelations other Medical Made! measures on different 
"populations — notcartelatad soc Faculurat faciers; 2 = Auequately Valaatedt te. some studies on different oenulations: 
1s Poorly Validated ie, few studies: 6 © Not validated ie. ne studies of negative Sndings. 
How Wali Trained was person adrrinistering tetrs 30 = Wen uained= 2 = Adenuately rained: 1.2 Poorty Hamed: O = Mot 
' yained : f ~ 
What <6. Evidence the Measure 43 Racraity and Culturally Non. Diswcrit eer 3 = Well documented? 2 = Aceon 


documented: 1 5 Panny documented: O * No documentation. Evidence needed: Scores not correlated with, 


sociocultural factars: scores are transcultucal measures measure organism status not iaaenedt behawer, © 


Criteria: AY scores tor individual ratings on tour above categories sh ould be 2.or J tor all administered measures. Average 


Rating Per. Measure Scored shaouid be 2. of higher. ‘  & Be 


‘ur 3 imervention In canteropiated Otherwise, circle : 


BEST COPY 


Va 
'e 


an 
Vw: 


A 


ie 


-“ 


,OMINISTERED 


Tora . ‘ . 
“Parton” } Was oir. 2 How Wi | Trunet > yp Bvidenee > pf Enter NFL F = nr eae 
: Gueweden Aleune ge! Adhten ening Fagrea? Variciar Perarinner> © | Non-Oherh,! 1 sh nge Faia 4 : © 


Th Acanemne Meh. Test | 
iahaaiogaes =s 


4 2. Nonagad, Sch. Rates 


a as 


t 2, Farnily Roles 


4. Paer Group Raley 


| 
| 
f 
i 
ee 
i 


- Tastruchins foe Comaieting Form: 
Was Glrension Tastes 1 < Yer Q= No NR « Nor Avievany Nor 
mentioned ys pant 


the preneet 


Woodie ahoniy wu Level bh 2. or 
fate? Soe Wygt Vaiduted is, Maets xh stiteriae ct 
anes TASH Cole On several ashnic sroagt: | = Poors Vatidatedt he. 


Alow Weis is Measure \ 


51 


hy Maletlared 


yY wihte students 


8 = ‘Nat Vatidarec ia. oa © udies oF negative feedings. . 


sods Os nee Tea 


ar eatary © A> Cheat evidence wv » Some aviience 

‘ et 7 ' s : 

S foo ratings gt indveitgual rests shouic be 2or highs? UH testwas neers ead, When. es NA, there must 7 : : 

ANCE that the tes Ss indeed, net relevant, Average Rating Fer Measure as should be 2 ar higher. , 
Se 3 


tons unbiase: 
ge Erenben Tans: Sntaasee’ 2s No evidence, Qirect Measures 4 


pratt 
as ; & sirerias Bat s 
we” ; be clear 


= 
=. 

hee | 
3 
ae 
= 
AE 
ww 
? 
a 
es 
3 
3! 
. 
gS 

oJ * 
“a 
= 
=: 


eases ae ra isa a acted tan ae tel ae 


Kk. 


BEST COPY 


“REPORT OF SOCIAL ADAPTIVITY OR SOCIAL SYSTEM MEASURES AOMIN HSTERROQ . ~ 


on) : Pare Pa ~ e 
= ; . * ” Se 
> Edherrgreg Meysorst . . = . ae Teal i : " 
t Peesgr War Ores, How Welt Trained . Enaende sEnter NA 
. | , vot Te Po Auminigrnag sO Tested? Vatelaced? * Pessonmar? sie a Nee Fret sy 
; . 193210- 210 i an . , 
3 “ PaO ’ 
wey e ss 


oP Te arades GPA 


- Dine ‘Soeertyi, a oO 13940 4 te 2p + 
far Coreplati . 


“Wag Cimension Tested’ 1s Yes Ge Nal Nie, Fs Nes 3S Hetevant, An Xot is inserted for Qlmensions 2 nm ghaet oecaute. | ‘ ‘ 
adutned io data from thie teacher “always teigvant, avery maenensenal assessenent, ‘ ‘ 4 . e 8 tg 8 
me . ; as 
. e * > . . ‘ e fe % a ts 
Scoring of the other ‘catigar igs is" ‘he same ay desgrtngdd Siege PSY CHOME TRIC MEAS RSURES, . : 
perenne hee - “ 


. 
, 
‘ 
La 
-_ 
Perea etn ee ne Sn a iar ens 


REPORT OF GENERAL INTELLIGENCE-OR PLURALISTIC MODEL MEASURES ADMINISTERED 


a . . - 
> : Pee Oars ‘ eo, Ca Tout 
» id itd . > + 
j: ee : Parson Waa Dim. How Wel! \. Trained 
| ‘Dimension Mewiucri i Natneof Tes: | 


y Evinence , tenner Net 
: 1. Auminittering (Tested? [ vatitared? + Personoe > | Non-Oscrun | it act Rel 


i }, Gloval “intelhgense i 


t ’ ' 
PONR/} 3-219 U22 noe 


2. “Verbal “intelligence” i me : . Fionn [azio0 | 
is eee . P ~ 


j as Orner-iSpecity) j : LONR EP S210 F3210 1 F290 


j TetaliO-4Q) Avarage’ Rating Pe: Measure Score © Total S(@-NR'si< 


in ‘actions for Completing | Form: 7 . 


*yen . 


Avs Dimension FT Teves: 


Same sastructiOns as.onburiieeigemsys. ose ee ks 


Mow Welt is Measure Vatiheiad? I= Clearty meats atl assumpnens af ieferemtial meyciet for erring “nreiligence” 


freets assurnowons af indetaniial moetel ox Questionabie i meets assumptions. 
evedance that it does mot meat-assumptions. 


2 = Partially 
O = No evidence it meets assumption, ‘or 


z . “ é 
How Wet! Trainect wat Parsor: Aiteninistaring Test? Same instructions at on earlier ferme: ee se re 


eninatory? “3 Clear evidesce an weveral etter: 


Evites Wwe Measure i ts Bade. ally and Custarait Now Neri 


‘Cyrouns 2 = Some evidence 
weve t= Qhags 


ie peictenge + miginty Speculation Q = No evidence it isnon-discrimgfiatory Yn making 
yp are shar here 3 diserimination. : 3 . 
- a me . ? 7 A os 
‘ % : = 5 “ . ws 
a . . 3 . 
ea 7 a : 4 


EPORT oN ASSESSMENT T TEAM UTILIZED IN ASSESSMENT 


“Team Member _- 8 ‘Pollece  Collece” See Not os 
em and > Data. Involved © | Relevant” 
“ . : Brg Mo i i ‘ _ . ; : interpret Only” a 


- Educationat Pepcholocst oft ot. 23 i: Sn oe 
ce similarly trained person ‘a eo . 
8, Nurse’ or other tnedically i a 2 ) ae 
“trained person, on : - 
a Social worker, ‘Visiting | . - oS. 2s ee ' 
. teacher, of similar person ee su 
om “Classroom teacher wea a ae 1- 
5. Special’ Education Teacher, _ 2 nS | 
ae resource teacher, aera, - , 
~ trained. person’: ¥ : - os, 
6. Parent(s)'or parent advocate ane 3 
7 


on The child slog: assessed a -° 2 


Total (Range 0. ia a —_* . — 
_Instrdtions for Completing Form: - be oe 


Cirbte the. nome that best dactripes the degree of involvement ot the type. of 
person described in each of the seven categories. In cases in which the referral . " 
was for a very specific. need (vision test, hearing test, etc.).the involvement of + 
certain persons might not be “relevant” to the. ‘problemi and -NR would ben 
: _ circled. ‘However, in a// cases the teacher, parent, and child would be involved at 
- some level. Hence, NR is not an appropriate response for those neiduale: ae 


~ 


25 invalvehene pot at the level of collecting and. interpreting the data.i.e: 
(full involvement oh the assessment team. ss ne 
: ts involvement at the level ot collecting data. — either by prqviding the data 
(as in thé case of the parent, teacher, or child) or in collecting: it-(as in the 
“case ‘of the social worker Conducting the parent interview, .the nurse. 
administering the physical dexterity tasks). The category indicates ‘that the 
“individual does not get involved in the assessment planning conference in 
which data are interpreted, the diagnostic construct built, and the IEP. 
developed. a : 
_9=No involvement at_any tae! 
ONR = Not relevant. This category should not. be ‘used ifs the preeeatinn. probiem = 
» was in the area of that particular person's professional expertise or if the — : 
" contemplated placement is at a higher level of restrictiveness than level 3..: -- 


“a 


Perera Tee ace Tranny 


x 


198-0 this characteristic. would be divided’ into two. types. of ae Shhose. & 


‘for Swhich- > partial diagnostic’ constructs were eloped ‘and oo ult 


es % hal 

Oats ig0% 75% “50% 25% OK: 
a a “percent ar the cases for which partial. eae Bae a _ Oo 
“constructs”, ‘are indicated. were tested for > 7 oo 
“specific problems: indicated in ‘Ynitial refer- an 


ral? . 


; What percent of the cases for whieh the ~ 
a “restrigtiveness: ‘of the intervention was Level 
ae <a: ‘or higher were administered all the meas- 
; ures: ‘needed for a: full diagnostic, construct?” 


Validity oe Measures 
a: What percent of: the cases for: Siig full. 
constructs were. required had: an average . 
‘ tating of 2or higher on validity of netics! 
‘model.measures used? 
“2. . What. percent had an average réting of ) or - 
‘higher On social system measures used? 7 
“3 What percent had an. average rating of 2-or 
* higher: on oo intelligence mocel meas: 
: wes used? 


> 


: Trained. Personnel. meee Sener A 
1, What percent of the cases{: 
rating of:.2 or. higher orp 
personnel administering’ 
~ measures? 
: 2 -What percent ‘h 2 
: shigher- on the training of personhal’ adminis. 
“S tering measures iri the - social adaptivity ; 
’. model? sy . — 
3 ‘What percent. ‘had a rating of 2 or higher on 
training ‘Of personnel: administering general 
_cintelligerice model measures? 7 
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SECTION II 


- Implementing. the 
Protection in Evaluation Procedures 
~ Provision. of P.L. 94- 142 


James E. Ysseldyke : 


tn 


a) 
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_ from the University of Hilinois, he has taught special education classes and been. al 
; sychologist. - Professor “Ysseldyke is. co- -author, with. John Salvia of a- 
: text: entitled Assessment i in Special and Remedial Education, ‘and has published - 
\ . numerous journal articles and book chapters on assessment. In. 1973 he received 
> the. Lightner Witmer Award from. the. Division of School Psychology of the . _ 
_- American Psychological Association for his research on diagnostic-prescriptive: Pe 


+ 


N INTRODUCTION | 


‘The: recent and significant revisions fin | public Policy: on the edutatige of 7 
s handicapped ‘children are reflected in: the: provisigns. of Public ‘Law 94- 142, the 90 
: : Education for All ‘Handicapped’ Children Act. The la lay is-eesigned 5) meet four wa 

‘major Purposes, ‘described by Ballard anc! Zettel (1377), . as follows: oem 


“As Toto guarantee that special educational services: are “iaiable to children 
‘. need them, — 
oe 2 “10 assure that decisions -making regarding Provision of services to handisped' 
students i is both ‘fair and appropriate; = - : an i” 
3) to establish clear management and auditing requirements: and procedures for eed! 
"special education at all levels of government,and 7 : 
4 v0. provide Federal ae to. assist states in educating handicapped ‘chitdveh 7 
and.) Mg eae ee 
Public Law 94-142, along with Public Law 93- 112, -the Vocational Rehabilita- 
tion Act. of 1973, represerit significant. entrance af. legislation into the special. 
edtication arena. This paper focusés on one special provision. in Public Law 
94. 142, the “Protection. in Evaluagjon Procedures” provision. Thi $ provision of. = 
7 the Law (Section 615-5c) Sette wap and their localities will develop: 
in i . 
“Procedures mm agsure that rent: ney and _evahiation rogieria's and procedures: Mie 
S ubiized For Une purpases of evaluation and olncement}9! hanrlicapped chi Idran : 
wil be selected and administered 3c as, not™tembe racially (or culturally 
. .scriminatory. Such materials o ar procedures shall be provicied and admini- 


stared on the onlid’s Aative tanguage of. mode of communication, untess qt 
£38 At fa ewe ta do se, and na single procedure my he te 3 


. * 7 Me by tae ra ‘ 

Lacal and State education agencies are required to demonstrate compliance with 

these “Protection in Evatuation Procedures” provisions of the jaw. Specific rules and” 
Jar 


ee ee for implementation of the PEP provisions were published in the Federal ~ : 
» Register, August 23, i977 (pp. 42474- 42518). These rules and regulations. specify 
that: * : oe 


i ta the inka olacernent ota handicanned 
child in a special education program, va full and inidividua! evaluation, cof the chiid’s. 
educational needs must be conducted in accordange with the requirements of rule ‘ 
1219.532 (Rule 121a53))0 | = , vs , 


2. State-and local education agencies shalt INSUES, atam nimuin that: 


+ Before any setlon 15 riken re respec 


(a} Tests and other evaluation materiais: 
(t) Are provided and administered in the child's: native languagecor 
ather moda of communication, uniess if is cleanly not feasibte to . 


a a RL 
« (2) Have been validated far theyspecific Purpose for which yey are 


145 


shied: and jen 
> 43) Are. administered by trained personriel” in conformance with? the 
a instructions provided by their producer, , : - 9 a 
tb) Tests: ancl other evaluation materials inélyde- those intended Xo assess oy 
“os specific™ areas of educational need. and” ‘not merely ‘those which are. 
Ve designed. to provide a single general intelligence quotient: .* 

oS ele) Tests are selected and administeredso as. best to ensure that when a test 
ae (adm: nistered to a child with: impaired sensory, manual, or speaking — 
eae skills, the, test results accurately reflect the child’s apti tude- or achieve- 

; meat level: ‘or whatever: ‘other: factors the. test purports, to measure, rather. 

than’ reflecting the: child” s impaired, sensory, tnanual, or speaking skills ° 

fexcept where, those = ai Sluas are the” factors wet the Aas. purports: to 


aoe 


_& measure): . ah. - . St te 
tay No- single procedure ris us Jas ‘the sole criterion for. ‘determining ans 
j appropriate. educationai program for achildSand 5 OC a: 7 


fe), The evaluat: on'is made by amulti- ‘disciplinary. team or group of persons, 
; including at least one teachdr or other specialist with knowledge in the | 
area of.suspectechdisability, - . é 
(fi. The. ‘child. is assessed in all areas . elated - to the <uspacied disabiity, 
including: where appropriate, health, vision..hearing, social and emotional 
status, generat intelligence, academic, performance, communicative sta: 
: tus, and mato r abi ties {20 U.S.C, 1415 (b) (2) (B) (12 1a: 532 a-f}) 


. This paper addresses the gfnoral | sue of assuring ner SEAs and LEAS have a. 
Means at evaluating fhe - “extent to.which their assessment procedures. are in 
compliance with the “PEP” prow sion and. its. accompanying rules’ and requiany, 
dons. Part, bof the naper is a oniet' overview of the ways in whi ch the. concepts of 
nondiseriminator: f assessment ancl Dias in assess ae have been address odin the 

professional fterature. Part TH, is an overview of factors which must. be” 

“considered if we are to address satisfactorily the issue ca bias in assessment. Part. 

Ui. ‘ends with this author’s interpretation of nondiscriminatory assessment’ and! a 


pi Statement of the rationale for the posit! on developed. co oes 
iN Nes 


— . 


. Part Ut is an outtine of Factors considered in developing specific criteria for 
, evaluating effective imolernentatian ofthe PEP provision, while Part IV ts a set 
f ccteria. OF standards for use in ev aUa Ng — smpletentstion: at the PEP 


~ provision. * ar ; _ A, SB) at a 
, a : ” t, Pa . 


f : 


. * é - : 
TREATMENT OF THE CONCEPTS OF NONDISCRIMINATORY 


ASSESSMENT AND BIAS IN ASSESSMENT: - 
A LOOK fa THE PECEESSIONAL LITERATURE 


The issue of bias in Assessment has bean with us “fora tate: time and. i a / 


a * dealt with variously in the professional literature, Early research on Ms in 
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assessment: -Segan, with the Observation that ‘when’ norm: reletente tests: were ae 
administered to. students from. mpijority and. minority: groups, the members of 
the, Minority group on the. are lower spores, The fact that, in general, "aaa 
average ‘scares alo’ ee SOURS of minority” students tench to. ‘be. lower ian, ie 


regarding the reasons a the. Gbserved dinereaces While some investigators have 
argued: “that observed ° differences: between groups tor. the. most. part’ “reflect” 
genetic differences. between groups, others-have argued ‘that observed | differences 
are’ ‘primarily ‘due to differential ‘environmental effects. The> “positions af... 
“choice” these” "days ‘appears: to be ane “interactionist positron’ in “which. athe. 
performance ‘of an individual: on atest is viewed as a function: ‘of an interaction - - 
- berween genetic, and environmental influences; The, nature-nurture debate has | 
; produced; within. the past decade, & plethora of. theorizing and numerous 
"< Sempirical investigations. Investigators have debated. the conceprof “intelligence.” 
= (Cattell, 1963, 1971; Elkind, 1969; 1969; Guilford, 1967; Humphreys, WO7V 
: - ‘Merrifield, 197 1 Mernon; “1969;  Weghsier, 1971): and the: relative contributions — 
to intelligence of. genetic and environmental. variables iBayley, 1965: Bereiter, ues 
“1969; Bijou, 1971; Bloom.~¥964° Bodmer & Cavalli-Sforza, 1970: Burt. 1967; 
"Butcher, 1968;, Cattell, 1953, 1971: Cronbath, 1969: Crow; 1969; Dreger: we 
_ . Miller, 1968; Eckland, 1971: Ealis. Davis. ‘Havighurst, Herrick & Cronbach, 1951 ;~ 
os Elkind,. 1969; ‘Erlenmeyer: -Kimling & Jarvik,-1963> Ginsberg: & Laughiin, 97S 8y 
Gordon; 1971; Breenfielet, 1971; Hirsch; 1971;Hunt, 1961; 1969; Hunt’ Kirk, F 
~~ 1971; Jensen, 1967, 4868a, 1968b, 196921969, 1971; Kagan, 1969; Li 9715 a 
— Mandenberg, 1971). a ae number of F studies have Deen designed : te Javestigate - 
the fairness. of tests by: comparing the performances of groups of Studlents on - 
": Norm-referenced tests (Boone & Adesso; 1974; Breiand, et al. 1975. Butler,” 
Coursey & Gatz, 1976; Gi! more, et. at, 1975: Goldman & Hewett, 1976; 
- Gui Hiams~ 1975: Hartiage & Lucas, 1976: Hennassey | R Merri iffeld, 1976: " 
‘Hoepfner & Strickland, 1972; Ron, 1974, 1976: Kallignai, 1971; Matuszele 8 
Oakland, 1972: McNeil, 1975: Mercer, 1972; Neai, 1975; Peck” 1973; Pout 
x Sedlacek): 1971; Ratusnik BP Oenigsenechit 1975: Reschly, et al. 1976; mI con, 
_ 1976; Temp, 1971), . 


~ 
: NY 


Investigations of group difterancas in Y per formance an psy ee dey ices led ; 
. other investigators to ‘examine the thirness - of specific items as used with : 
members Of minority groups (Ang & Ford, 19717 Bre 1974: Breland, et 
momen a7 Duravit T1975; Fishibi i Graen. ions gy Roudabush, 
1976; Lord.“1976; Merz, 1976; Newland, 1973: Pine & Weiss’ 1976: Rudner, 
1977; Schauneman. 1976; Smith, 1974: Tinsley & Dawes, 1972). Specific. , 
~sub-camponents of the research on “the extant to which | specific tests and: rest - 
items. are biased against members . ‘Qt minority groups haye been observed im 2 5 
* research. on linguistic bias (Bartel. Grit! & Bryen, 1973; Berry & Lopez, 1977; 
Bryen, 1974: Johnson, 1973: Lefley, 1975; Matiuck & Mace, 1973; Matluck 8 
* Mace- Mailuck, 1975; Nathanson, 1975;- : Masquez, 1972) and on: sex bias 
(Diamond, 1976; Dwyer, 1976, Evans & Sperekas, be Fagjen- ‘Steckler. et.al. 


a gars 


° Research < on -differences in: ‘the fer formance of groups at eudinec on, tasts has 
“ted: x0. the vigwpoint that. a ‘test: is biased if it fails to ‘identify proportions df” 
ndividuals ‘gomparable to: ‘proportions | in the. general: Population. For éxample,, if 
a test, were used to. select sttidents for: admission: to.a University,. the. test would 
be said :to: ‘be biased: te in resulted in the selection of a lower ratio.of Blacks, to 
* whites. than ‘their ‘porportions: in ‘the general’ ‘population. TF 11%: of the gener 
population 1 Black; and the, test resulted in he selection: of a ‘population 


Te pimexios ee Pe ee 
“The regression model was: ‘origin lally proposed by Cleary (1968) who defired.a — - 
biased. test as follows: , % 9% = 


fe “rast is “biased for mambecs. at a sub-group atthe population - if, in ae 
predi fCUON of 4 criverion for which, the vest is designed, consistent: nonzero: 
arrors ot. prediction are ‘made: for members. of the subgrouD. In other words, Ra 
- the test is. biased if the criterion score predictad. from the common regression. 2 
ei consistently roo high or tuo low for members of the subgroup. With. this , 
definition of ‘bias. there ray be a cannofation, Of cuntaiz,” partiyciar: Vit. the 
use of rhe rest produces a prediétion that . too low to. 118): : 


cp The Subjective Resresion | Model. 

: This model, also referced to as the Culture’ Modif ed Criterion: Model (Pétersen & 

“Novick, 1976) has-been proposed by both Darlington (1971) and Linn (1972): = 
a Proponents: of. “this: model” believe: that fairness can be achieved. only. bys Ss 
~ Gombination of the. ‘Quota Model ant the Regression’ Model. “Accordingly, one + 

oe dendes, if ‘there is some merit. or value in selection of members of some 


ultural: group, ‘or. rit there} i$ potential harm i an exclusion! lof the members ‘ots some 


group, and then sets” his/her regression ‘equations. account for desi 
representation i in selection. : . : 


The Equal R Risk Medel. 


oe 


he.: Pauad Risk: Mode: was: probosed for use in inde by Guion (1966), 


a0 
iter ‘by ‘Einhorn and Bass. £1971). 


According to. Guion (1966), ° “Unfair. 
iscrimination exists when persons with equal ‘probabilities. of success on the j jo 

ave. uhequal’ ‘Probabilities ‘of being hired: for the job." “When. assessment devices; 
are: cused> to. select employees, and when persons with sequal. probabilities fe) 

: “suecess have unequal. probabilities of ‘selection ‘die to the use of the devices, th 

“devices ‘are: said to be unfair or Biased. A test is fair, 


from this, perspective if it. 
results in the selection: of. ‘persons for. employment or parti cipation, in an activitiy : 
in. a -porportion, equal to. the proportion. of: those who succeed! in that 


a employment or activity, Applied to educational setti 
. be fair. if it simply séle@ed for entrance: into college . for. example, the sar 


Proportion... Of individuals from "minority groups. as could be expected oO. 
‘ complete college sueestally: ; 


as, a test would be said to : 


. The Constant Ratio. Model, 


~ 


i. ams model, probesed by Thornui ke. 970, ‘states. that a test is, fairs 
resilits in, the selection of the oronortions of differant cult 
be achieved if the person doing the selection had available each subject's exact 


_” score® on the criterion’ “measure, ‘According | ta Throncike! ees in a fair 
: “selection procedure: oo : 


a 


when it 
ural groups as would ~ 


The quatitying scores” on ae: “test should — set at thse that wiit qualify 


applicants in the two groups in* ‘proportion to the fraction of the pya. ‘POUNDS, 
"steaching a specified level of. criterion performance (oe. 63), a Re 
Ei - s ae s : r ‘ 


_ The critiealv variable in ‘this: model is success” on a 


fail to predict success’ for minority or majority ve 
2. ‘the-constant 


a criterion measure. Tests that” 


rSONS are. said to be biased. Thi 
ratio riodels weCIUSE ‘fairness. i a5 evidenced | when ' ‘the | 
. _ Proportion: of those’ selected to those successful, is. the same for any: two groups... 


ay _ 


™ Conditional Probability Model. .~ 


poe amounts 


: This, model. proposed by Cole 4973), again dhesec he relationship be 
Success ¢ on a test and success on a criterion measure. Cole states: 


teen 


: ~ 


i 
3 
: 
r 
Hy 
i 
t 
on 
es 
? 
i 
t 
i 
; 
i 


tisfactor' ‘criterion: score: UY: Yai there ‘shouldbe: the ‘same ‘robebility of 
‘selection Ey achicha ‘of grote membership bo. 240). : 


Several investigators ee feviewed ne. models of test Fairness (Frater: “9978: 
Hunter. Be ‘Schmidt: 1976; Linn & Werts,, 1971; McNemar, 1975; Petersen. & 
: Novick,: 1974, ie 


The pliesvon, “the: scone Ratios tha: Cond itional Probability; the “Equal 
Probability. the, Equal: “Risic: and the Culture- Modified Criterion. Modeis’ are. 
each explications of generai- Concepts ‘of what ‘constitutes.the fair use of. tests 
‘ina ‘selaction situation, There seems tobe nothing in thie: literate: that cle 
indicates: when, if ever, “one. ~of the? models- referable» aH the ‘other. five. 
models, Thus, the pract itoner, “has: no ciear guidance in the: ‘choice ofa 
culture: ‘fair. selection model, Further: aye have suggested that the Constant’ 
Ratio a. Lines Condi tional Probability. the Foust Probabilit ry Models and tt 
} aS are incernatly.¢ contradictory : 


oSharf, 1977: Wackstein, 

Anthony, 1974; Mogan, 1974: tisk heron et at ; ¥ 
“wilh ams, “1975), and. discuss’ ons of the social and legal consequence? of using: 
~ tests te ciadsity’ individuals (Eons, 1973: Pegt| 1972; Green, ideal Allg 1973.3 
" 1936). a : ; ; ft 


‘e 


‘Cronbach (1975, 1976), has provided an, excellent analysis. of the socio- e-poliical 
nature of thes. arguments regarding Aesting. The: considerable - “controversy 
regarcliog this ton: c has” fesuited in the recent publication. of humerous position © 
papers. (Barnes, 1973, Bersoff & Y sseldyke, 1977; Cervantes, 1974; DeGeorge,y, 
“1975: Fitzgibbon, 1970; Flaugher, 1974. Franklin, 1974: - Green, 1971;. 
“Humphreys, 1973;Jensen, 1974:. McCleliand,; 1973; McNemar, -1975, Meeker & 
_ Meeker, 1973:. Mercer, 1972: Messick, &A Anderson, 198 1980; t National. Association — ation 
for the’ Advancement of. Colored People, 1976: > Northeast Regional Resource 
“Center, 1976, Ratteray. ‘1974: Samuda, 1973; Scales & Smith, 1974: Scarr. 
1977: Southwest Regional Resource Center, aes Weber, 1978. Wiltiams, 1970, & 


eres Zirkel, 19721, 


Poa, nis nation ly its researchers have ‘Vested considerable ator: time, aaa : 
financial resources injatteripts to develop or identify assessment devices that are 
not biased against members of racial or cultural groups. 


OTHE RATIONALE. FOR THIS. PAPER 


Rent: of: “Congressional: testimony, relevant to the eitece in, Pea Gatien’. 
Procedures” indicates ‘an obviously much: ‘broader: concern than simply with the 0: 
“fairness. of: tests and. test items as used with members of minority, groups. This”... 
roader: concern Js: with: abuse an the entire process: ‘of using assessment clata to 
ake decisioris: ‘about® pupils. Th: ‘is _this broader _concern, abuse” ine “decision 
making; that" ‘this position. ‘paper addressed. “Abuse is evident in many, arenas: 
relevant to assessment’ ‘of children and includes: 1): inappropriate anc: indiscrimi- >. . 
“rate : ‘use of tests, 2). bias in ‘the assessment: of handicapped ° children, ‘and ine , 
dentifying 2 as. shandicenped ‘those: whe - are. not, a bias “throughout the, ’ 


stating that. the: “real conéern’” is with abuse | in assessrhent aniddecision-makin 


_ThetCopenitice: is “déeoly’ concerned: about Dractices anc prockaures. whi ich 
; = result. an classifying chitdren as. havi ing ‘handicapping conditions: swhen) in fact,” 
‘they ‘de nar have such ‘conditions. At least three. major issues are. a concern 
. with respect. C probierns” “identifcation’ and classif ication: VV. rhe misuse a 
< apbropriath identifcaron and classification data within: the educationat ‘process . 
= itsel: 42) ‘discriminatory. treatment, as- ‘the result of the identifeation of a 
~-pandicanping’ ‘condition: and J3)- misuse: “ot” identification ‘procedures a 
“methods. which, results: Stee erroneous" classifications: off a chilet as shaving ‘a oo 
Ne. ok Education for Al,” 


ee: pratt “use ape * 


~94:168, ‘Education tor x0 Monaicacped Children ‘Act.. Sune’ 2, 197 
26-29), ~ = 


: There is ‘considerabie disparity” between ways it which ‘protest idnal ae 
have, to. date, been a esis thes! issue. ‘of bias’) in. ‘ssenmancand theasways ar 
a ae ; 


Develonment™ “of tae Free. Tests.” oe “have prapesed « “we cengage + 
extensive efforts to develop Culture testes Such efforts, historically, have 
* ‘been impossibte: because there. is no culture free learning. Learning gccurs in-* 
os environmental contexts and. ‘in fact,: consits pri rnarily of the. iseuleation. ia - 


“the culture. a -. asa : eee oe 


“Development of Culture Fair Tests. Efforts ca been iatia to constrict tests © 
in which items are “balanced” so- they represent, “multiple languages and 


cultu eS ~ Such efforts ae been unsuccessful. “Culture fair” tests have not: 
demonstrated. ood predictive’ ‘validity; ‘they. ‘are poor predictors of success: in. 


mono-cultural school « system, and have oct for: the. most part remctd by : 


the ‘dominant: -cultural group. 
Develop nent: of ‘Culture: ‘Specitic Tests. Elforts have been made,’ “aS noted 
to. develop “ cuiture-specific | tests: (specific: to. the Black culture, | 
Hispanic. culture, ete). ‘These tests, Vike culture fair. tests; have demonstrated. 
iow’ predic ive validity, and. have” “been fejected” ‘by the dominant. cultural: 
: ‘group: ‘Production: of such devices: shas been difficult, ‘because no-one. -test will: 
satisfactorily: assess : ithe heterogeneous group ot children int any | cone e cultural 


ss afforts: ‘have not. “resulted in “fale assessrnent: specifid’ items are. ‘as pol eurally” 
“vt dependent as” are items. n more traditional scales, anc predictive, validity is” : 

eo ‘inguistic” Translation ay ‘Existing “Tests. Efforts. to. administer. tests. 
‘- children” 3 ‘native language have often: consisted of. translating existing” tests: . 
ee nto! oun ease Transtatign changes item difficulty, and” destroys the. 


Cs of Adrinisieaton, Procedures. When handicapped youngsters are 
assessed, assessors “oftery try to achieve fairness by changing administration. 
“Sprecee surest We: witness, for eBample, the ‘administration of verbal tests in ‘sigh, 
language. Ro deaf and hearing- ‘impaired children, Nonstandardized administra- 


“tion procedures: ‘disallow the -use of; existing. ‘norms, and -untess, special. 
.,populati on PORES” ate ‘cbastructed,, snorm-feferenced interpretations: are 


~ Aix 


arapassible, . te os : : Ls 
3: Fraining “Children: to Take. T ests. “Some: researchers and. practitioners have: , 
- advocated thatthitdren be “trained. to ake ‘tests prior to being’ " assessed. 
j ~ procedures® haves “rangect from train! ng ‘in. test-wiseness:, to. task 
rization training. This. issa viable way to alirhinate or reduce observed 
a variance due to lack of famili arity with what Is being required: Th 


_ precar is: "a time: ‘consuming, but worthwhile caltecnative” ‘to> traditional 
cocedures. At wil not, however, reduce, many aspects, of biasin ~~ 


Norms 0 ~Eisting “Tests. Mercer er Rew . 
ntem.. of Multicul' gal Plurali tic Assessment (SOMPA). Fhe a 
system uses 5 exist ag tests, but plur Hstic, norms, Separate regression equations 


: a ares used to. compute the: estitnated. learning pogintiat, of chiidren’ from Black, 


' Apolo, and Chicano’ groups: One difficulty’ with such a “procedure. isin. 
re 


. accounting for me extremely Heterogeneous natiite of any one Poult or’ ‘ 


eth nic qrour 


Professional ‘decision: makers: have: repeatedly: strived to identity fair assessment. : 
ractiees. Today, though, we very. often observe SEA and LEA personnel. ‘engaged 

efforts designed to-identify the. fair test for. use with racial, cultural, or ethnic 
minority. roups.. Such~ efforts: could §o."on for a very. ‘long time: “without - 
producing. “progress toward ..non-discriminatory assessment. This fact was 

illustrated by, Salvia: and Ysseldyke (1978), in. their - overview of apealinccos) 
assessment. A description of that reasoning follows, 


ee 


cles tests, ‘ike any tests, care nly Siraplee “of. behanor: Any student's as 
performance. on an intBlligence test is a function of an interaction. between'the = 
kind (s} of behavior(s) sampled, “by” the test.-and > the» kinds ® of background ba ae 
“experiences, and Opportunities - that children have ‘h d- in: “both formal and a 
7 informal . educational environments. Given the tremendous variation in back- 

* ground: ‘experiences with: which children enter testing” ‘settings and. the; ‘large 

~ number of differant kinds of behaviors sampled by tests, the number of. Possible » 
interactions is larger than we can even: begin to realize (conservatively ‘estimated 

“by Salvia: and Ysseldyke as greater than 1.35 x 1932 possible: interactions). 
“Educators can, and probably. will, argue. fora very long time. about’ ‘which. of 
“these interactions are “‘fair’’. We will, make considerably more progress, | believe, 
ay by addressing ~ something “we ‘can. effect: “bias in the: entire process of a 
decision. making. ‘In establishing the position taken. in this paper!.it is necessary 
- first to. describe assessment and: decision: “making and men to deccrte ‘the. factors ae 

that | believe: mist be considered. = BoE 


Assessment Defined . as 
. 4 view assessment: -broedly as the process of collecting data for the purpose of 
helping: a professional make decisions about inidividuals. ssessment is. not 
7 synonymous with testing: testing is: simply | one part of assessment. “Assessment 
“may include direct observation. of inidividuats in natural environments, it may 
include the obtaining of data from others. by” means OF irterviews, and it may © 
include the obtaining of both historical and current information by searching of 7 
. records. Clearly, many, different kinds of data are collected. im the process of. 
decision making, in its bhoadest sense,.this data conecuag, process is assessment. 
Salvia and. Ysseldyke (1978) identified. five differant iade af decisions made i in 
educational_settings...Assessment_plavs_a_kev.s.cole..in...themaking..ab. these... 
Temes decisions; . data gathered by means of assessment are used in decisign- making. 
‘The five kinds of decisions described by Salvia and Ysseldyke pe are e briefly ; 
a8 follows. - ; 
1: Scleoning: dn demeaning, data are collected fot the purpose of helping a 
professionals identify: ne extent to which a student’ s. behavior differs from -* 
“normal” or,’ ‘average’ " behavior. Students whose behavior is sufficiently : 


ae erent eur “normal” 
.. for further: cassessment, a . Ago ie 


2 Placement/Classitication Decisions. Assessment date are routinely: ‘collected i in, . 
educational settings for the purpose of helping professionels- decide how to 


classify: students, for the purpose of declaring children-eligible for special 


educational services, and-as an aid:in making placement, decisions. Most state 


education ‘agencies require that. before children are ‘phaced i in classes for-the 


handicapped, they ‘receive an individualized psychoeducational evaluation, , 


_Plules-and regulations for PLL. “94- 142 (sec, W2ta. sal require that: 


| 

: Before: any action is taken with respect to. the initial placement. of a. 
handicapped child, in a special . education’ program, a full and inidividual 
~ evaluation: of the child's educational needs. must® ‘be’ conducted in. accordance | 
: with the’ requirernents of rule Wa, 532, 


+ 


“Many different. kinds of data are catlectéd during individual evaluation, and 


these data are ‘used to make placement, eligibility, or classification decisions. 


in the educational process, the appropriate identification of handicapping - 
conditions must take place in order to assure that a child receives. ‘appropriate * 
services: designed to méet his or her needs. identification must also take. place. 


a to enable SEAs and LEAs to. plan appropriate services e deugned 2 to meet the 
child’ 's. unique needs. %% : 


“3. Instructional Plannihg Decisions. Assessment data are routinely colletied for a 


“the pprpose: ‘of helping. educational personnél. plan instructional. interventions 


for’ children. Specific efforts are made to identify an individual’ $ educational- 


ly relevant Strangths and weaknesses: to.plar precisely’ ‘what to teach and how 


to teach. Data collected ‘during assessment serve as the basis for Hlanning both 


? 


. long term. educational goais and specific instructional objectives. 


> individual, Pupil, Evaluation. Teachers, parents, and students themselves have ° 


a right and a neva £9 ‘know: the extent to which gupils are-progressing in their 
educationat Programs. Assessment data are provided .that enable. decision: 

makers to judge the extent to whigh progress is “being made, both in the 
achievement of specific instructional objectWwes and ae reference to a jecal or. 
‘national sample of age: or grade- mates. 


§. Program -Evaluation Decistons. Data are pallesied for the purpose of; 
- evaluating the effectiveness of educational programs. Typically, this consists 


either of comparing the progress of students in two or more programs, or of 
looking at the extent to which pupils are attaining program objectives. 
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o. tm 


are typically tofared for or identified as candidates 7 


oe 


FACTORS TO BECONSIDERED. _ 
-INAHINKING ABOUT IMPLEMENTATION: 


re 


OF THE. PEP PAOWISION: eee se 


te Nas” “been noted: that" esessment ig the process ‘At collecting date. for the .s 
, _ purpose of making ‘decisions. for and about students. Educators. need different re 
~ kinds of data to’ ‘help make ‘different. kinds of decisions. Abuse i In assessment are 
~ occur when educators fail to differentiate their decision- -making procedures: and “ 
the devices they. use: in light of h different | kinds-of decisions they make: This 
“boils down essentially to the use: fFtests for purposes other than those for which 
_ they” were designed. For example, norm-referenced, individually administered. . 
intelligence. tests were origi inally designed to help. us make. ‘classification’ and 
a placernent decisions. Weswitness, however, the routine practice of engaging in 
oe ‘profile: analyses of subject scores earned on norm-referencpd ‘tests in an effort.to. 
antify i ivitv strengths and weaknessés, ny ales of. these data in 
instructional planning: Such a practice is without empirical support and may: 
actually constitute abuse... ae ES _ 


“-» “Acculturation 


.. Any child’s performance on a test is a reflection of past learning history in both | 
formal and informal educational environments. As noted by: Salvia and: 
| sseldyke (1978), acculturation’ “is the most “important characteristic: ir 
_ evaluating, a child's performance’ on a. test, To the extent that a child's~ 
_agculturation’ differs “from the acculturation: of. those on ‘whom a test was: 

: standardized, norm-referenced decisions based upon test results ony acueny be . 2 
pe invalid and biased, Fa 


= When normsreferenced t tests are used to shale Audios about: students, assessors 

. _roust examine ‘the: extent to. which the student assessed is like thosecon whom 
“the test was. standardized. This is especially true-when a child.exhibits one or 
_faore specific “handicapping an deafness, blindness, .or cerebral 
palsy). : 


Jeane Greet, 


When assessment peed are. used to. make important decisions about pupils, itis. 
imperative that those. devices be: technically adequate. "Several factors must be 

, considered. The. first is again the issue of standardization, Scores earned on 
norm- referenced tests reflect the ipartormance” af the napl relative: to those on. 
whore the test was standardized. 


A. ecsite: consideration is: that of reliability. Reliability felons simply to the 
3 consistency: with, which a device measures a trait or setof behaviors. Reliability . 
indices tell: us how much errgr there is in. any measure. In assessment, we. are 
“interested. in: ‘obtaining results that adequately reflect student traits, characteris- 
tics, or ‘behaviors; we. want our results to be as free from error as is possible. 
“Nunnally (1967). ‘provides some stan cores regarding how reliable devices must 
be. He notes. that ‘when tests are-usedsin ‘experimentation, those tests must have 
- reliabilities, that exceed 50; and that when tests are used to make important — 


- decisions about pupils, ‘those tests should. have reylepiiaes that ex ceed 90. 


ite “has bee qrdemonstrated: (Salvia & Ysseldyke, 1978; Vsseldyke & Salvia, 1974) 
that very many of the norm-eterenced devices. used to make decisions about - 
pupils: jack the necessary reliability to be : used in decision making. When 
_ unreliable tests are used to provide data for decision ® making, those decisions. sorts : 


may be. based more. on error. than on actual pupil characieristics. at BT ae 


ry 


The third issue regarding. ‘technical adequacy is the: validity of the devices and oo: 8 
“procedures used to collect data about children. Tests must be valid for the a 
‘particular ‘purposes for which they are used. Assuming that tests measure what 
: ~ they purport to measure, ‘when .there is little empirical evidence to suggest they” 
Pee 5 are valid, can lead to bias in decision-making. : 


re 


4 


“Tests as Samples of Behavior = —- .s y 4 tee 


Tests are merely sueipies of behavior. in assessing a student’ $ jatatligencs, for 
éxample; we do" not directly measure intelligence. Rather, we observe’ the ways 
: in which the student.responds to sets of stimuli ‘presented in a standardized _ 
~ Format. Student’ performance leads us to infer deqree of intelligence. “Intelti- 
gence” , thus, is net an observable phenomenon, but an inferred construct, 


* Different tests sample different behaviors. Student performance on a test can 
we oe only be viewed as a function of the kind(s) of behaviors sampled by the test. The 
, greater the. similarity between the kind(s) of behaviors sampled by a test and the 
_kinds. of bthaviors to which Predictions are being made, “the lesser the aS of 
inference involved i in assessrnerit. i , 


Bias in Decision: Making 


lt was noted earlier that the issue underlying the concerns expressed in the PEP 
provisions of PLL. ‘94-142 is bias in decision making. | beliave that af eclucators 
suddenly had the fair test, there would still be “considerable bias” in ‘decision- 
making. Recent research has demonstrated the extent to which naturally occur: 
ving characteristics act to bias the kinds of decisions made about pupils. 


* 


« 
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; tent.to which students’ physical 
attractiveness affects the kinds of decisions teachers make about those students.~ 
“They sorted school pictures of third grade children into 10 piles, using aQsort | 
‘technique and asking raters. to rank the pictures of students from those who 
~ were least physically, attractive to those who were mast physically attractive. ; 
“The itwestigators selected pictures of. children who had, been: rated most. 
‘physically. attractive and: those rated least physically attractive, and affixed these __ 
2 : to idéntical psychological: reports. Reports included identical. objective data 
regarding pupil -intetlect. and prior achievement. Data provided were borderline. _ 
data, data. that could be used to support a label of either mentally retarded or 
a normal. Four groups of classegom. teachers pate given the identical reports, but. .. 
 INOMe case the report included. a picture ofan attractive. third. grade boy,” |. 
another report. included:.a’ picture of an-unattractive third grade ‘boy, the third. 
Group: received a report with a Picture of an attractive third grade girl, while. 
ae group’ four. received a report with a picture-of an unattractive third grade girl. . 
Given identical objective information teachers reached different diagnostic 
___ decisions as a function of. the physical attractiveness of the child, Attractiveness 


acted as a biasing factor im the kinds of diagnostic decisions reached. 
oa : i oa ea? : 


ie tae . Algozzine (1975) extendedt this research "by looking at the extent to which 
, pupils’ physical attractiveness affected teacher-pupil interactions. He found that 
’ teachers interacted significantly less often and more negatively with unattractive 
“< than attractive Oupils. Salvia, Algozzine and Sheare (1976) examined the grades 
” that elementary teachers assign to attractive and unattractive pupils. They 
examined the cumulative records of *children identified in the earlier study by 
Ross and Salvia as attractive and unattractive: They found no difference in the 
no + SCOres that these groups of students earned on intelligence tests and on measures 
- . of academic achievement. They found a one-grade-point difference in the graces ay 
“. os © assigned by teachers. Teachers were assigning higher graces to attractive than to ee 
_ unattractive studerits, : : , oo : . 
q . 
Further research on the extent to which naturally occuring charactéristics affect 
decision-making was completed by. Salvia and Podol (1975). They obtained a > 
& - photograph of a child with a visible repaired cleft palate. They had the 
photograph retouched so the the repaired cleft was not visible.. Two groups of 
speech therapists swere given the sarne speech sample. and told they were to_ 
evaluate the speech of a child with'a repaired cleft palate. One group was shown. 
* the gicture of the child in which the repaired cleft was visible: the other group 
———--—-—-was -shown-the-retouched-photo: “Signiticarit differences Were abserved in the * 
: ratings of the same speéth sample. : id 


These and similar studies itustrate clearly bias in decision-making. Given 
eo —_ objective data, decision-makers reached differept-gonclusions as a function ot 
: s diagnostically itrelevant pupil characteristics, : 


oY serie’ of recent investigations Woster & Yefeldyke’ 972; Foster, Ysseldyke & _ 
ht Reese, 1975; Salvia, Clark & Ysseldyke, 1972: Ysseldyke & Foster, in press} has 
lead to ‘concern regarding the extent to which the identification. isions we 
a reach’ “about.pupils directly affect their later life opportunities, - These’ iqvestiga- - 
tions have examined. the ways.in: which: identification of children as- chandicapped * 
causes teachers to view them differently and to Hee objective examples , 


of viet behavior. : 7 oe 
_ ¢ . . . 


\. 
Cesier and Ysseldyke, £976) investigated the effects of deviancy—labels ‘on 
teachers’ exbectations of child bebayior and ‘on their ability to evaluate child » 
‘behavior abjectively. One hundred ‘elementary: teachers wete randomly assigned - 
to one wfour. groups. ‘Each group dealt with: one label emotionally disturbed,” 
learning. ‘Uisabled, mentabby retarded, normal), and: each group. participated in’ 
two-separate treatment phases. During-Phase | teachers identified behaviors they: 
expected to be displayed. by hypothetical children denominated. by the label 
“condition. Teachers indicat®s, for ie: a behaviors: they believed a — 
‘ “typical mentally retarded child” would onstrate. During Phase II, or 
- group wewed the sarne videotape ‘ot. a ‘normal fourth grade boy engaged ‘ina 
variety of activities ranging from formal assessment to free play. After watching 
the . videotape, teachers were. ‘asked to complete a checklist indicating the 
: behaviors they had observed. Experimenta! conditions were identical - across ° 
. groups with one ee was told that the child was a member of. 
oa different category, that whe was mentally rerarcded arnotionally _disturbed,” : 
. “learning disabled, or normal. | a ee a rae a ot 


Results of the investigation indigated that teachers 4t)> hold nagative expecta ; 
tions for children to whom disability labels have been assigned, and (2) maintain 
these expectations” even when confronted’ with narmal: behavior, behaviar 
inconsistent with the stared label. Maintenance of this bias-was sufficient to 
cause teachers to misinterpret actual child behavior, resulting‘in a hajo effect. 

* Results indicated that the label “educable a fetarded”’ generated a greater 

degree of negative bias than did the labels * learning disabled” or “emotionally, Aoi 

 disturbed,’’ although al three deviancy, labels produced negative expectations 
and halo effects significantly eierent from those found under contral 


conditions. s ®, 
’ This uliy of (eens: Apteaducee another consideration: into our ‘thinking 
. regarding bias. We: ‘need not only be concerted about how the decisions we make 
: “are biased, but, vat oii at time aboutathe effects of the decision-making os 


a “process. 


a 


- Nondisrimminatory assessment entaiis several factors i in complex ir interaction, “Ast 
“noted earlier, our real concern should. be with bias in the decision-making 

: process. and with abuse. in the use of assessment data-to make decisions. about. : 
- students. Abuse can occur in many different, ways. First, abuse can result from: 
the use of tests for purposes. other than those for which they were. designed. Tt 


in ‘several: characteristics. Third, abuse occurs when technically inadequate tests 
- are. used to collect data about. students: It also occurs when investigators go 

. beyond | ‘their data to: ‘inter un rlying pathology and inter or: predict later 

acadginic 

occurs throughoutythe assessment process. Teachers differentially view objective, _ 

- child behavior when children are seioned deviancy labels. ‘ 


& 


4. FACTORS CONSIDERED... 
4 IN'DEVELOPINIG CRITERIA 


~, No one set of criteria will segve universally to eva te LEA implementation of 
“othe. “protection jin “evaluation : “procedures” prov sions of P.L. 94. 142. + Boh ol 
. ‘districts and states differ, both in the nature of the. populations they serve andi in, 
“the nature of the aservices they provide. Therefore, in. developing criteria’ to 
‘evaluate implemen. ation of the PEP Provisions, several. factors were taken into 
“consideration, te “ 


Ww 


anberretatonahigs of Stipulated Services 


: 


. P.1.g4- 142 stipulates several different services _ individualized educational 
programs, due process, placement in least restrictive. environments, and 
7 protection in evafuation procedures. The PEP provisions are obviously, related to 
: the other three stipulated areas. As noted. earlier, assessment js engaged in. for the 
purpose . of providing data that- Will: help professionals. mane: decisions about 
studenys. The Giterent kinds ic decisions were described. oe og oe 


ae “Assessment. is. an integral ‘caiiobtedt of the assessment- intervention process. 
— __ Teachers. routing ty-collect, data-about-s students. “PROF -tO- making-decisions- about: 
the most appropriate IMsteus stional programs* “for” ‘them:. At aS" required that” 
assessment * ‘preceed the - making of. educational ‘placement decision vel 
process ‘hearings: parents | and others are sinformed about and-have .a- right: tos = 
~ challenge. the assessment ‘data: collected on: their. children, To ‘the: extent, that 


which." shay wert designed. USE. of technically inadequate ‘tests 
dlecision- making ct can result. . : 


can. also-result from comparisons of students to.others who differ systematically. ~ 


difficulty. Bias on the! Basis of naturally occurring pupil characteristics.» 


“Changes in Implementation ¢ Over Time 


=. ~ i 


It is believed’ that LEAs will make steady” progress, toward implementation’ ‘ot the 
PEP provisions of P. Lu. 94- 142. The criteria specified later in this paper | are of the. 
“nature that such pragress can be documented and. demonstrated. Several criteria : 
specity- that: LEAs: routinely-monitor: their assessment procedures: and evaulate “p 
“heater togwhich both the procedures and their effect-are nondiscriminatory. Pag a, 
Such: noe eae. ‘should: enable LEAs to spot areas of diffi ‘culty and to institute 
.. It Was thought that use of the criteria should iead an. LEA | 
with the letter: of the law. to eventual compliance with. the _ 


“spicit or intent’ ‘omgthe law.. — _ 8s 


Contextual Influences, Se, ” 

. a " 7 P 
_LEA contextual factors, such as-its urban-or ural environment, or the length of > 
é time that the LEA has been implementing state policies similar ‘to those 
_ expressed in P.L.. 94-142 are likely to influence: implementation of ° the’ PEP 
provisions. The criteria developed later in this paper were developed 50 as to be 
useful - and applicable in nearty alt contexts. All: LEAs, regardless of “contextual 
factors; angage in decision-making.and stand the chance of making biased or 
discriminatory decisions. While it, is recognized that. different LEAs make. 
“decisions about different kinds of constituencies, the criteria should apply across 
the board, This author has little regard for time considerations. if educational 
personnel are making important educational decisions about children, decisions 
that directly. and” significantly affect children’ 5 fe opportunities, they should be 
‘using nondiscriminatory procedures in assessment. 


> ” 


“Multiple Approaches : o _ a ge 


- . ‘ . “ a 


Mt is ceboaniaed that LEAs may employ dttferent approaches or procédures in 
‘ implementing the PEP provisions. The criteria develoned !ater_ in this paper 
“should apply, regardless of the specific approach used by an LEA. 7 


_Relationship 0 LAO, ee ae nee aS oe ne eee 
To Assessment Methodologies | 


“Theauthor hae aeproathed the task of developing criteria with one over-riding 
- \ belief. The ‘only assessment "methodologies that should be employed in 
- educational settings are those for which we have empirically demonstrated 
support. In -very many instances today educational personnel collect data on 
children ‘that are of tittle relevance to decision-making. For example, research 


ae, 


has. repeatedly” -demonstrated- athe: absence or support ‘for the atticsay* of 
_perceptual- motor training designed: to improve children’ s per formangeth reading. 
~ Yet, schdol _systems ‘continue. to provide remedial programs characterized by 
“perceptual-n ‘motor training | and ‘educators continue. to believe that’ it iss vvery 
“important -. to. “assess children’s modality preferences prior, to, Prescribing -- 7 
‘instruction al interventions (Arter “& Jenkins, 1977; Ysseldyke, 1973, 1977). 
‘Clearly, a major consideration relevant: to: this paper is the extent to which aan 
‘educators engage: in or believe in- procedures for” ‘which there is. little=if any . 
; “empirical: support. The -use of .ry n-reliable tests (Ysseldyke & Salvia, 1974) to a 
assign children to instructional programs for which there” js no demonstrated | J 
ae support, represents abuse in asses ent. ; 


Definitions of Concepts / 


. Special effor't has - ‘been made, wherever s it was, believed necessary, to define the ; 
concepts used | in the criteria, 


| SPECIFIC CRITERIA | ee oa 


; Collection of Information. 


pea : : 
- Assessment. is a data collection. proeess,’ hed ‘educational persorinial “routinely. 
7 collect information on. students and their families for the purpose of making ~ 
educational: decisions; ‘Since 1974, when. “Congress: Passed Public Law. 93.380, - 


- qui delines, should have poticies. na procédures’ rabarelng ithe kinds ‘of data: they 
ae can’ collect, ‘and clear quidelines: Tegarding the obtaining of ' consent from parents” 
in the data collection process, : 


The: ‘quidelines sud regulations of Public ‘Law 93- 380; appiicabie to 9 the collection 
of information on all pupils, are articulated further in Public Law 94. 142, for it” 
iss very: ‘clear. that: _Sbatifig nigeedures meee’ to .be followed | ‘whens chi ndien are 


ras ‘that LEAs employ: certain’ ae in theieoce of referring children: vad 
valuation. The. evaluation process begins with referral: failure to pregiloy_ 
ecific procedural safequards ¢ can contribute. to pabuse! in the assessment process. 


: The:first consideration regarding seleceal should be for: the kinds of behavior that. 
: ‘warrant ‘concern and referral. Children: ware ‘typically referred for psychoeduca- 
: tional evaluation when - the~ behavior they ent RS ‘sufficiently different front 


normally expected beh tor that a person: ‘in a ‘agition to do so” ‘becomes 
“concerned and cats them to. the attention af diagnostic personnel: To the. extent - 
o. that ‘teachers: do not: have a good understanding of. normal. ‘child: development. 
S7 and.a commensurate understanding of behaviors that. are considered’ ‘deviant, 
2 “over: or _under- referral of ‘children cam result, More, importantly ,.. failure; to. be. 
aware: of cultural differences. and the extent: to which specific behaviors at 
deemed” appropriate vandé ‘or inappropriate in ‘specific, “cultural environments ca : 
: ‘lead to. OvelOF cunder-refercal of students. who are members of those: specific 
“> cultural: ‘groups. Furthermore, the specific biases. of individual. teachers toward , 
= specific naturally-occurring pupil characteristics can lead deachers to over: refer 
sor, underrefer childred who demonstrate ‘those: characteristics. . ‘Diagnostic, 
=-personnel ‘must have: established procedures for: monitoring “the referral! process. = 
“I, “their LEAs ane must -systemati ically examine and evaluate thar process. ee 


Whenevs: fone. are referrad for ba cro siucanane sitet “educational 
personnel must inform parents of the specifics of the ref ferral. informed consent". - 
rhust be obtained. from _parents prior to the evaluation of their children. Parents | ae 
must be told who. referred the child, specifically those behaviors that are reasons 
for concern, and provided with’ objective docuthentation. of the gegsons: for 
“referrai.:in- language they can. understand. Schoot. personnel must. “nd tonger 7" 
address evaluation. in “generalities Hike « "We want ta Lest your ‘child to See. if. 
anything - WS wrong with: her," and. must not. assume that parents will. not. 
understarid the seasons why. the child i is being referred. Honesty in communica: 
ton at this point. will alleviate: ‘many potential difficult! es later in the assessment 
and dlacision- making, process. “Informed cansant: means ‘that phe parent” ior 
pupil) i$ ‘reasonably. competerit to understand the nature and consequences of 
“his. decision’ ‘(Russell “Sage Foundation Confer ence Guidelines, 1969, p. a 
(Salvia & Ysseldyke, 1978, Pp. 437). . 


. Soeuite criteria to be used in judging the zatent to which LEAS referral 
procedures are in compliance with” the PEP provisions of PL 94-142 are as 
toHaws: - 


. LEAs have. established procedures regarding the kinds of data that-can a 
collected.on pupils. sles , 
2. LEA procedures regarding the kinds of oe vat can be aclieciglke an ‘pupils 
care consistent with the guidelines and. regu! ations of Pubiic Law 93-380, the . 
- oe Rights-and Privacy Act aes ana a ne | 
3. Diagnostic - personnel routinely meet wi ith groups of teachers: to provide ; ~ 
|S training in the kinds of behaviors teachers should and: shoyld not be looking .. 
~™ for in considering children for referral. : 
4 The LEA has a record of. ‘the numberof childrer referred™ by individual 
; teachers and regularly examines this record to ascertain the extent to which 
> any one teacher has a history of. over-referral of children from certain > 
cultural groups: or who demonstrate specific. common characteristics: 


gs guardians @ are re indore es a refercal has been: mi 
“as. Totd who made: the ref al. Pai ae 
- : be Tald precisely: why the. referr was: ‘made. : Sage 
ae Provided : with. ‘objective: Yocumentation. of the: ‘feasons fee tetra nn 
“lariguagasthey can uinderstagd. Me ae A sob 


‘ iy Paren are regularly invited. ta, Participate in the assessment and decision: 
_ maki fei for their children, \ ; : : : 


¢ Finlorhouens care collected. ify the making of educational decisions, ‘and 2) itis i : 
* highly, ‘untikely. that any one person” ‘has. either the time or ‘the necessary 
: compet encias to engage in all oi of the data collection process, Ce 


“educators ie spent donileranis time ‘debating the issue of wb should assess - 
- children, The’ ‘my turf — your turf.’ debate has repeatedly been ‘aired in both 
the - professional Nterature and at otot. ssional. meetings ‘by special educators, 
emedial . reading. teachers, school ee. speech therapists, guidance . 
ounselors, social workers, and scighrators. J arn not as concerned with the: = 
- issue ‘of "Wwho'’ assesses children as | amiwith the belief. that-children should be. ey. faa 
ae Tassessedd only by those who have the necessar\ Sota 


ompetencias to do so. 


eS 8 sijnititent enough ae to. demand path competence and, 
> mnultidiseiptinary cooperation. Yet ‘I have no pat solution Jo the. problem or 
- issue: of assuring that anly * : ‘competent!’ person make decisions “about children. 
During the last. decade we- ‘have ‘witnessed repeated. difficulty *i in defining. 
competence ‘in educational setting. When it comes to decision- making, ‘the 
"definition of competence is far - more. slippery. Many’ ‘different kinds of 


considerable: alt. cevalidation ‘and: Groh ilk responsibility. eletonate peisoanel” 
us tbe. willing to- recognize ‘and acrait their own: limitations, to: Tecognize that. 


other personnel. ‘for certain gate of an. avalualion. ‘Second, Bsychoediicational 
dacision: ‘making must be. ‘completed by teams of personnel; teams in which each. 
member As able. to contribute ‘both uniquely. and collectively. ‘Third, educational: 
decisions must ‘be. subject to: ‘due. process: td ingure that. checks ‘and: ‘balances are 
laced on decision: ‘making procedures: ‘In-some. instances, development of lists” ‘of: 
competencies: ‘to. be. demenstrated, ‘by. individuat professionals. may. be helpful, 
hough: the absence of any “policing” mechanism usually | leaves such endeavors 
ineffective, ‘ : : 


Decisions: regarding placement and or Siedning: of ‘specific’ nsvehoeduicational 
a interventions. are. decisions that require the active. Participation ofa multidiscipli- . ves 
ney nary team. “Individuals to be involved will necessarily differ ‘both asa function of 
‘the... setting and ‘the particular. child” for whom a decision is being ‘made. 
Differentiated staffing should characterize. ‘the decision: “making: pracess, Active 
3 participation. refers specifically. to. participations not. simply . involvement. When: 
“educational personnel make- important: decisions that. directly and significantly: . 
affect’ students’ life opportunities, it is assumed that they: will actually have | ce 
spent. ‘time ‘observing pr aennG chrectly with the chitd, os a ae 


aa ae . ‘ : a 3% ~~ 


¢ *, 
A third major factor becomes apparent when decisions are. ta be ‘riade regarding 


a student who °is .a member ; of-a specific racial ar. “cultural group, - ‘The 
phenomenon of cultural awareness must not be’ ‘taken tightly by educational, 
decision ‘makers. One major contributor to. past abuses in assessment has beer.‘ 
“thepabsence of “decision making of a person or persons. who had an adequate - uo . 
understanding of the” child’s culture, Ideally, minority group ‘decision makers = 
should Participate in “the decisions made about: ‘minority group children, At the - 
°: very ‘Teast, every: ‘placement . and intervention planriing team should . include 
: participants: fother. than the parents) who understand and: are aware . of the * 
super s cultural background. 


ny x 


“o—Finallys-tince-againt the role of parents ary” Or Guaruisersis eri tical i the eta ria 
—_ making Process: LEAs must be able to ‘document. the fact that parents are active 
“participants: inthe assessment ‘ang decision- “making ‘Process. Paroprs should ‘be 
consulted at the time ot referral, should be treated: ‘as . svanidsi ‘source of 
developmental data during “the evaluation process, and should» rant © “their o 
“informed: ‘consent. to the decisions | feached fegarding their child. hools are = 
- legally constituted extensions of the family: parentssentrust: Schools with. many” 
: responsibilities for: their children. Onty in. those instances in which’ parengal: 


: indude. at feast the following: : 

a A teacher who. has: taught the’ chil 2 

os Teachers to whose room the child may bs sasigned. 
o& certified ‘school PSyehotagist. oe Me 


a asiaee: making team: is a 
16. Parents are. guia 
a ‘process, ; 


a. the ate in ihe decisi ion. naking b process. 
“by the kinds of data collected and: the reasons, - 
a theese reine us : ‘hic ah th 2 


A. third major area of cons ider rath on relative to the ei of information ke 5 
5 the, kind of information to be collec ted, It has bee mented earlier that the ‘major ~ 
governing: mile ladies ‘of decisis 
es the aan Fe, Pier kinds | 28 
of formations LEAs rnust give evidence: of engaging in differentiated ‘data. - 


Yo OS 
| Numerous “roethodologies care. employed in - assessment, ranging fram ‘the 
collection: at historical information’ by “ee af intery EVE, 10. the: ‘collect?on of - 
AGU information regatding level of skil evelopment byt yne ans af formal’ 


. oe . 


ocedures ‘and ; 
ntollected.and . ~. 
Y matrix. « Hlusteattng this is 


vay 


erations > 


Nis cigrt: Coa ed 
ae fh a 


. pavehological, : F 
eds ucationar dlagnoses ; 


Teacher's reason tor 
retercai ; ese 


€ rom J. Satvia & J. Ysseldy«e (Eds. Assessment in Speqial and Remediai Educatian, 


Boston. Mass. : Houghton Mithin, 1978, eas te . : - . ee ; 


5, = . 4 
a 
. tes : 
es 
i Sas . 7 
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+ i . te ~ as : a e 
s 166 = F 
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most ian far. use » with this chiid?” one does: not: have, i. venture tar to. 
hear debates about whether a chitd should be ‘assessed using’ a norm-referenced: 
rest or a criterion- -referenced test, a ‘Stanford. Binet. or a. Wechsler, a Stanford.” 
; Achievement Teast or the lowa Tests of Basic Skills: There: ‘are specific criteria 
that’ should dictate the “specific test to be used in assess ng ‘children. These are 
; addressed: ‘below. However, two considerations are: important at this time, First ~. 
: thes process: of assessment should begin by asking “What behaviors ‘do | want to. 
or sample?" “rather than Wha est should © 1. use?”. Tests, _observations, ard 
© interviews are merely. samples of behavior. The -ki ind of behavior. to be sampled. 
should be.a function of both the reason “for evaluation’ “and the kind of decision © 
“to be made. _ Tests, or. parts: of: tests, or specific. test, items. ‘are. merely usect sin. 
“assessment to coilect t samples of pupil behavior, ' rn) 


N 


p ls 94. 142 requires 5 that multiple sources of data be used. an | décisionsmaking, 
ce regular: fons specific to. this. point read as follows: * a 


NS 


aS No single emesdurs shall be: the sole criterion for determining an appropriate 
educational placement fora chi Id, : 

-2. ‘The child °s ass sessed in all areas re! tated ro the juspécted di sability, including: 
where. appropriate, health, vision, heagihg, sacial and emotional Status, 
general intelligence, ecedemic performance. communicative status, and motor le 
, abit Les. vi : 7 ys . : ag - 


Models oe looking at aie kinds of data provided :by assessment were described * 
by Mercer and Yssalay ke HOTA. They exarined the Medical Model, Social 
System (Deviance) ie, Psychoeducationat Pracess Model, Task Analysis 
Model, and Phiiralistic f Mode! in terms of a): definitions of ‘abnormality, bd} 
assurrintions,. ch cKaracter istics of the madais, a) ‘charaéteristics of approonate 


: MHAASUNRS, ay ways Ta) which. ACOTES gre wm terpraredt, fi the: ‘natura at treatments or 


“UTE EVERGONS within each of the-rnodels, g) the extant to which each modet has a ~ 


racially or ¢ ulturaily ‘discriminatory effect, and h) two incidental categories of 
information. Table 1 from Mercer. & Yeseldyke, 1977) lists ‘the information. - 
Mercer and Y Sse " “ke noted that wach of the five assessment models, viewed 
provides only a. partial view of the ch ud. Attempts to davelop a 
nondiscrirn aatory Giagnos Uic-intervenation program: shouid Use -a multimodal 
Pe _aoAroach enh vehich the chtid is Viewed simultaneously fram ali five perspectives. - 


sonar rated: 


” 


Nor must multiple madels be used, but oupil behavior in multiple: settings 
7 must be considered. tn raking decisions about individual chiidren, educational . _ a 
aoa : personnei rust consider the congruence between ‘behaviors _ evidenced in 


different settings, When direct. naturalistic obser zations of pupil behavior and 
‘standardized rest results are ds sparate, explanations ought to be snught ‘before 
decisions are made. Wher multiple indices of pupil performance On psycha- 
metric devices sarnpling behavior frarn the same domain are incongruent, 


x ‘ 
5 


a Elemenas of “Medical 
the Model Model 
4) 


Presence af bio- 
logical symotoms 
- of pathatagy: 


Definition of atinarmal 


: Assumptions ; Symptoms caused : 
by biologicaleon. . 


dian, 


backqraund rot rate. 
vant to‘diagnass and 


* treatment, 


Sociocultural 


a 


: ve 


"Social System 


(Deviance) Madel 


Behavicr that ve 


lates social exnecta- 


tons for sbecttic® 


rota. ane 


es 
ue definitions 
of norenai are role 
and system ‘specitic. 
“Biological causation” 
nor BSSurLct 


TABLE ’ ~ 


OUTLINE OF. DIFFERENT ASSESSMENT MODE Ls 


Psychoaducational 
Process Model — 


. Psychoeducational 
process and for 
“ability deficits, 


ete deficip- 
Uren dem trate 
ie Strengths and 


vaiichy assessed. There 
are links herween cml 
dren's performance on 


fests aad the relative 
etiectivanass af | 
Wlerent insrrucrignat 
‘programs. 


Task Analysis 
Model. 
No formal detinition 
Sf normal or abnormal. 
Each child is treated 


* patne ve to himmsetf anc * 


“at in relarnce ta 8 


norn, 
Acaclemic performance 
is a funcuon of an inter- 


. 
achon between enabling 


- behaviors and the 


charaeteristcs af the 
task. Childrademon. 
evelopment, 


There is ng need to deal 


“with presumed causes of 


academic difficulties. 
There are skill bier- 
archies: devtionment of 
cemplsx 5xills is depen. 
dent upon adequate 
development of lower- 
level pnabling behaviors. 


Sand weaknesses, 


Pluralistic 
Model 
Poor performance when 
sociocultural bias 
conrroiled. © 
x 7 
Learning potential simitar x 


ir all racial-culturai grouns, 
Tests measure tearning and 
ace culturally biased. : ae 


{continued on next page) 


ee 


Tabie t~continued. 


Social System . Psychoeducationat 
(Deviance) Model * Process Model 


a ‘ : ~ 


Medical 
Model 


“Elements of - 
* the Model 
ne to. 


Nat cohtursvound, 
: Oaficikt model, 
ee . ; Deficit anc asset 
; _ " model 


: Ba 
Characrens tics 


Sosiad avarermm bound = Continuous macdei: 


degree of deficit, 
Evaluative: good de- 
velopment of psycho: 


and este bound, 


2 


sa Ban'tinusus model: 


Task Analysis, 
Model || 


a A 


claaree of ski! develop: 
ment. Bipalanwith 

sf a 
respecr.to specHic skiiis. 


Sococult urally bound. 


Pluralistic. - 


= - Model 


Asset mocfel. infers 
heyond tast performance, 


an 2 se . a “yducationai PrQIcesse Evaluative: high lavet : 
: : necessary to ucadernic! skill devetaprnent better : 
“ success, Deticit model. than Jowslevel skill devely 
a 2 norm-reterenced. : opment. Subject matter 
, 5 Disabitities or deficits ss referencect. Each child | . : 
fea : : are within the child, treated individually an 
: . : 3 ‘ Deficits can exist rather than in comparison ~ 
Be an . . ? . _ . unrecognized and to others, Idiagranhe. — 
vs a aoe a 7 undiagnosed. Corm- Based) upon task. analysis. ‘ or 
Pee ee pletely cunure bound, Skit development influ: : ef 
: : enced by sociocultural is 
ania ae Suauisd am einen weed emnanenn eoeanba dees es Sie te a gpa et as cabelas 
. . = * culture bound, . * 
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; . Group judgments, referenced assesginent. desi tindnts \ ° . * ; : i 
oO : xg 7 hy pathetical internal “ 7 ; 
‘ ~, : “ , determinants, . * . * 
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explanations must be sought. Scientific researchers routinely take into considera- 
“on: sampling: issues in their investigations. SO too in assessment, which is 


essentially miniexperimentation designed to answer a Pied eonnelenis hy po- ; 


. the ses, muitioie samples of behavior must be considered, 


Salvia and. Ysselcyke (1978) addressed in a very general sense the issue of 


: differential data collect on bY. sa the extent to which norm-referenced as 


opposed to criterion- be lone sts should be used in decision- “making. The use 
§ specific kinds of tasts was viewed as a Function of ‘the kind of decision. to be 
made. Ins creening, our primary concern is identification of the extent to which 


S@ student differs from “others ard further diagnostic appraisal is belleved 


“a 


‘ating Jndividual ouph erageass ond eects io program avaluation can be 
a rae oy means af both norm-referenced ane ort 


cde the farmer, arnpha sis tz ord aul: 5 


: on an ind: vidiuab chic tyasis, What AS impertant ta stress is the fact that 
a ethodgiogie 


“warranted. Suen information is most readily and easily obtained by admiriistra- 


tion of norm-referenced tests. Results of pupil Performance on techni ically 
adequate norm-referenced tests provide us a. picture of the st tudent’s standing 
rslative to others. Similarly, co remain accountable ja the making of geil 
tion and placement decision 8, educational administrators. must be able- 

document che fact that a chiidi is indeed sufficientty different from. others: th ve 


‘special educational services are warranted. Results af pupil performance ‘on 
dechnicaily adequate norm-referenced devices are most useful in fearing 
claps Coahier and placement decisions. , 


* 


“When designing, indivi dual educational programs for students, teachers need and 
"want to know snecifically what to"teach and how to teach, Such information is 


typically mot tmansmirteti ‘by atfording teac! 


ars ine scares oupils earned on 
norm-referenced tests. Rather, teachers ; 


specifically those skills 


~ that youngsters do and do aot have information ‘readily obtained by 


aiministeation of coterion-referenced reeasures, In atormation for use in evalu: 


ter nan. referenced orececk ar 


relatives to that.of others: 


in the datter evaluation grnining the extent to which pupils are _ 


attaining specific mR Rear eae 


nN 


Tt is not my intent here to specify to a detail the uata.collection procedures 


tobservation, interviewing, formal testing, infermal testing, etc.) that should” 
comonse an LEAs Gecision- -rhaking activities. Such decisions can best be rnacde 


wiflorarnt 


was Dae 


should Ge able to demonstrate that they are engaged i emer 
roenalegy: 


"an the b basis ol an ialucoctlen pei woes the kind ae dodiias nee wade, Sa 


170 


acculturation of the pupil being seceteed, and the technical adequacy of specific 
instruments. Yeti it is on this dimension. that the greatest abuse in. assessrnent has 
~ occurred. ; : 


Neariy every competent person who-has been trained. to assess children received : 


education regarding the kinds of tests that could and’ ‘could not be used. Yet, i 


decision-making must oe those that are desi 
are used. The most cbvious abuse of this"p ciple is observed in the profile 
analysts” of data obtained from intelligence testy for use in planning individual 
educational! programs for children. Intelligence test$ are. devices that. were 
en originaily” designed to assist decision- -rmakers in classification and placement. 
, They were nat designed to be used in identification of specific diagnostic 

strangths. and weaknesses far purposes of planning ectucational intervent: ons. 
Furthermore, there has been little if-anmy empirical suppdrt for the practice of 
using subtest profile analyses to plan specific. programs for children (Mann, 
“1971: Yaseidyke.. 1973) : 


, 


considerations 4 selecting specitig. tests for use with students is one of 


contribute ta abuse im assessment. Yet. it is readily apparer:t that this 
consideration is often over riooke ad in assessing pupils. ft most ‘certainly 3s 
overioaked-in tha assessment ra specific kimds of handicapped pupils. Gerweck 
and Yaseldlyke £1974), for eens responded to a survey conducted by Levine 
(19735, sooking at the kinds of devices used to assess deaf students. In that 
survey gleving raperted>that the most commonly. used test in assessing | deaf 
‘crit MG 

Children, Those who use the device are Violating a fundamental assumption in 


radically different: a 


Third, the use of unreliable and invalid tests clearly” contributes: to abuse in 


Jo have recommended that svhien tasts are used to make 


s about students those tests should have cellabilicies that 


decision-making 


Sees “deel 


an to redhuce error in decision- -making. This issue of high reliability causes 
. Special chfleuity for assessors, because many norrn referanced tests do not maat 


satisfactory reliability should be used in dectsion- “making, Ysseldyke and Salvia 


(1974) published a list of the measures of specific processes and abiliues often. 


used in decision- making and concluded that nearly all such measuras lacked the 


practice, ‘such considerations often are not observed. First, tests. ‘used - 
ed for the purposes for which they 


“Second, ‘most assessors Jearned. in their faning that one of the primary 
acculturation, To the extent that norm-referenced t tegts are administered to a: 
student for the purpose of providing information for use in decision- ~making and - 


to the extertt that the acculturation of the student. assessed differs fram. the: 
acculturation af those on wham the test was standardized, use af the device can: 


was the Performance Scale of the Wechsler Intelligence. Scale ‘for 


agsessrnent by cumaring deaf children to thase whose acculturation has been yy 


xceed 90. This is the figure suggested by Nunnally (1967) and is as high as ts) 


ther speci fied criterion: it as my belief. that only those tests that do have 


J am 4 


using them in” decision: making. . Any observed score’ is. a: function-of the 


Twa Syamoie of the sure Gre in-which a reliable test is. used, and one in - 
.which an unreliabie test is used, rnay heip clarify’ the reasons why | believe dt is 
~ important to use estimated true scores. 7 


Y 


3 scores at 86 and 90 {see Figure 2}. 


was revised in 1974 (APA, 1974) and te-titled Standards for Educational. and 


ghecessary -catiability tot eused in decision-making, Others have wgued that’ the 
e of. unreliable tes better . than not using tests in decision- -making. 
~Ysseldyke and Salvia 197 4) responded to ‘this challenge by computing indexes 
of Forecasting : ‘efficiency (coefficients of alienation). for each of the. measures 
“tht studied. The use of unreliable tests did not. ‘significantly mprove the 
prediction of pupil perform nce. Reliabilities - and rates of improvement in 
Prediction are listed in n Table 2° ee 


14 wong 


2 $ 7 : . 


‘Saivia and sseldyke- (978) ‘suggested alternatives. to ‘the. use of ungeliable 2 
norm: referenced tests in - decision-making. One alters native consists of using: 
-astimated true scores _ratheg, than obtained scores in reporting test results and 


‘individuais true’ “score plus error. The greater. the amount of error in. 
measurement, the greater-the difference between a pupil’ § obtained score and. 
her true score. Camputing estimated . true scores is one way of correcting for 


“error an measuremen ., The formuia tro de used in computing ‘estimated teue 


scares is: X° = X + frexl ix x). 


Let's assume that Amy, a thir grader, age B. 6, earns a Full Scale 1O of B5 on the 
Wechster “Intelligence. beet for Children (WISC-R}, and a Psycholinguisti¢ 

Guotient of 85 on the Ittingis Test of Psy cholinguistic Abilities (ITPA), Mean 
sores ‘or both scaies are “100, a reliability of.tne WISC-R Full Seale 1015 95 
for Bt year-old’ student: the’ religbi lity ofthe ITPA PO for elght-year-cies is .66. 
When we substitute these values into the above equation,. we get estimated true 


et ” = 


The princinie 38 demonstrated that the estimated true score “ig a regression of the 


cae obtained score toward the mean. The lower the raliability-of the obtained score, 


"the greater the pegression toward the: mean. 


A second alternative consists of restricting test use to devices.having reliabitities 
greater than .90. ° . 


than 10 years ago, a joint committee of Ge Ameri ‘can See cal Associnlion, 
American | Educational . Research Association, and the National Council on 
Measuremant in Education published ‘a document entitled Stanclards tor : 
Educationab and Psychological Tests and Manuals (APA, 1966). This ‘document 


Psychological Tests. The standards;docuiment stated that “A “manual or research. 
HEDOEE., should” present sd ~evidente” of vaticlity for each type of inferenice for 


- 
MEASURE ; 


ese y 


titanate Achievement Test’ {Subtest Rei iabitities) 
jowd Tast of Basic Skits t 4974 edition). 
Metropolitan Achievement Test es 


: Brantford Acnievement, Tests 11973 edition) 


Gilmer e Oral Reading Test So gaan 
“Gates- eee Reading Diagnostic 7 Test: : 


 Siantord beaanost Reaair ey Test (1926 edition! 
Silent Reading Diagnostic Tear - 
~“Diagngsti¢ Reading Scales , 


~ Stantord 0: agnos ic ¢ Mathematics Test 
Stantord- Binet Intelligence, Test. ve 
‘Wechsler Intelligence Scate'f ar Childrer =Revised’ 
staan “Verbal . 
fo “Performance 
Fuit Seaia :. 
Subtebts,- so oe 
“Weehster Ach sit intel uence, Seats” . 


é Verbat ee 
Performance : 
Full Seale’. . 2 =, ges 


n rascr 1001 aged Prisnaty TAS ay 
: “Verba 0 . ee 
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N Performance 
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which use of the test is recommended. tf - validity for. some suggested 

, ‘Interpretation. -has not been investigated, that fact’ should be made clear“ (p. 31).. 

_ The U.S. Office of Civil Rights expanded on this position in its publication of 
a regulations relevant to section 504 of Public. Law 93-112, the: Rehabilitation Act 
sof 1973. The Office of “Civil Rights stated essentially that tests must have 
demonstrated validity. for the purposes for we they are used. | am. here 
articulating that position ‘once again, ae ate 


Abuse can and doas occur in detis! tone making’ whieh invalid measures are used to 
“ provide data | on students. tr oday’ 5 Schools, invatid tests are very often used. in 
; deci sion-making. “Fhe clearest example of this. can be iNustrated by calling ; 
Bat : attention to’ a .basic measurement principle all. “assessors: learned during their-~ 
 teaini ng: Reliability i is a necessary but not sufficienticandition for validity. Given. 
that ‘many of... the devices used to make. decisions about pupils do not have 

" adlequate raliadill ty, they carinot be said to be valid, The use. of invatid measures 

to obtain data should cease. a 


* TESTS “can 7 RBS iously contribute, t6.: Jnappropriate ide oesatines Several 
oe Rost of them very obvious, are relevant to this. point. Again, in 
__ test administration examiners must pay. special attention to the. acculturation of 
“the individual assessed, The first st¥#p- in test administration, is selection of they 
“behaviors to be samp! tedden Failure: Rte) consider the accuituration of the chiidand ~ 
its: ralabonship to the acc: whuration of thase ee por atest was, Standardized: 
can te ad to sar Fog errors. in interpretation. 8 Os So come 


Locai ‘education agencies must also have wavs of assuring that test aciminigtra- 
fagsionals. «Co 
\ + SSUES Shing rapper: witht children, a3 well as skill in correct administration, 
: Scotti. pid otenerelctich of tests. — : 


von is carried out by commmetent aa) LAS TENTe includes sks rf in 


we \ 

“8 One other considaration: 15 selevact to the. administration of — The ‘PEP’. 
“provisions of Public Lav; 94-142 stare that tests: are to be. administered in the 
* child's native language ar mode of communication. This provision creates speci ral 
dfBculty for LEA personnel, Clearly. if a chiid’s native lanquage differs from the 
Y used in asse Ma ngtential for abut remaking 


sé in cacisi is inate ed 


- ‘divers saciaky ig AG “easy task. Dees ‘one consider a child’s native ase guage to he 
the language shoken by the parents? ‘Tf so, how does one qo about assess sing 
chitdren who are, in fact. biingual? Doas one consider achiid’s native languaue . 
to be the.one which, hashe first iearned? Or does. One consider the child's native a 

language t to be the < ane which her she Js ow: most fluent in? There.is no vraatlily 


apparent way to arrive at an answer to the dilema of assessing children in their 
native language. Furthermore, compliance with reas provision is complicated by 


a = 
fp 174 5 


tala ee oe SORE 


acculturat ign that differs ‘from ghe- ‘acculty ration ‘of children ‘on whom 
stand ardized tests . avere. normed, Straig ht: quantitative ‘inte rpretation of test - 
scores 1s ane ie ropriate. Rather, pupil: performance must be looked at 
in fight of the interaction. between the. acculturation of the individual assessed .- 
and the: vies of behaviors eakuens by thejdevices and Procedures: use. I believe 


have to come on 
performance on tests. 


sreased 5» intaligent ube af tests and in teepretation of pupi! 


4 


The second-oart of thes mative: i language I 
ume, - 1S eo tS ‘assess: shiidren using devices. designed to be used with 
indivick uals who communicate in the! same way. .Oeaf and hearing impaired 
children, should bé assessed using: rests standardized on the deaf and hearing 
impaired. Blind children should be assessedt using tests and procedures developed 
. for use with the blind, Cerebrai palsied youngsters shouidl be assessech using tests 
devised for use swith the cérabrai palsied.| A Jery common misuse of tasts is 
Witnessed ie the use oftests standars dized 9 anes a3 


to gather dara for vse in making decistons abc 
: 7 


a 
' 
an 


. Rte, 0 eit . . ’ Pay 
individuals, Bo - ue ae es 
Speciticasitayia relevant to mis section are a8 fa) é 


ny 


18. dca! Education Agencies ate able to document for every 


“Mrtacement decis SHO is made, the follo owing information: ‘ 
a. The primary language spoken in the child's home... wo 


Jb. Arey unusual social anc cul 
ec. The chid’s race, 


d. Tha axtent toowkhich. the 


3. That 
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uy rgannet are atale: to clo 


Pact tat the agaéssrmeant 


Wg. Educat: homal pe 
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20. Educational perso onnal routincly ohserve children they assess in more than 


a 
soliect are palevant tocthe kind o > the 


are making. 


lone setting (.e., home, group. instruction, indivietual ing struction, play. etc) 


rovision can be complied. with atthis 


sori R anuicippe c chi Idren | 


child about shom-~ 


pal Yangueige spoken is one: ‘other than ‘Enolish have ‘deadly exper nee an 


at 


a 


Sas 


Sa 

- Observed ‘scares are > eonverted® to estimated ‘true: scores Prior. to. can - 
interpreted. ~ wy 2 . : ; 
i Any time difference - scores or deficit scores. are. “used to identify children 
* said > to. be- ‘handicapped: the feliability” of ehgse difference “scores - 

. computed and included: in the report, ee . 

23. When norm-referenced devices are used to make. decisions about children; _ 
ms diagnostic: personnel are able to identify: the, extent to: which the child. 
assessed is like . those on whom. the test. was standardized. Variables . 
i considered inglude the following: nae pa ee oo 


a. Age. Chi ndeeny. ot “the same chronological. age were included: in the 


standardization group... , vs : i 
". 0. Grade. Children of the same gr rade Jevel were included ‘in ‘the standardiza’. 
tion group. j 


c. Sex. A representative. ‘sample. of children ‘of. ‘the « same gender were, 

* included in the standardization group, “x < : * 

~ -d. Acculturation of Parents. The standardization aroup included-a fepre-, 

sentative sample of children whosesparents’ acculturation was like ae of = 

the parents of the-chi ie agsessed. » . : 

a? ‘Geographic ‘location, .There are “childrens. Jin the ‘standardization sarhple 

~. - who live in the same geographic. region as the child assessed. ; = 

f. Date of Norms. Norms forthe tests used | in decision. mnaking are’ relatively, ad 
‘ Current (within the- last 15 years). " 

Qo Special’ Population Characteristiés. it the: child assessed hae: apegitic. 
Phe nied al conditions tie. deafness, biindness, etc. Us thite are similar * 7 
chi dren in-the standardization population: re ar 


24, When ‘educational Scenes norm-referenced stests to make important _ 

. 8 decisfons about children, they have evidence, that me tests are validefor the he, 
. _ Purposes for which they are used. 7 
ky 


28. Norm referenced rests. used tO make. Important t educational decisions about , 4 " = 

~ \ghilciren have reliabilities. that exceed 90... : 

. 26. Diagnostic personnel are’ able to. state ‘the reliabilities, of the tests and | 
3 subtests they use in decision making. ; 

: 27. Children are always told why they are ‘being assessed. 

~. 28. Diagnéstic | personnel are: able toc docufhent the fact that in every assessment, 

the physical environment of the test setting has not adversely” affected the 

* obi id's ee Thea fotle ae factors have been considered: 


c Inadequate space. - 
ed. Lighting = . 
e@ Appropriateness of furnishings: for the child. sgize fy ee 


Tasts st ecitiied according to the directions and procedures specified 
in the manual. ‘ : : 

, ‘Adequate’ precautions were taken to insure that the exami nae understood 
procedures and materials relevant to the test. Se ; a = 


a ee ws o, 2 ae 
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‘ Test r ‘results are ceporied and interpreted withie ste Singles scores sare . 


32. When. ‘placement decisions are made, “diagnostic personnie give as much 7 
aa weight to adaptive behavior as they do to other data on the child. a 
: Papit behavior i in oe Settings iS sampled: an therprocess  afgeiion 


< Decisiobamakers ae he page 
domain (in Higence. specific achievement; per 


‘Use of Assessment information 


A wise 2 professor ance said” There i i$ ; nothing wrong with ee it’s the stupriegles 
that. ‘use them". Repeatedly we hear. voiced the position thatgfests, in-and of © 
themselves are not bad> but that: problems arise when they are misused. White: - 
such. statements have appeal and a certain degree of validity, - they must. ‘be. 
modi fied in light of some of the points ‘made’ earlier in this, paper: There are 
Aumerous inadequately standardized norm: referenced tests that unfortunatel 
are routinely used to make decisions aout. children. There are many technically. 
inadequate tests that are routinely used to collect information on children. The ~~ 
previous ‘section of this paper addressed concerns relevant to- these points: This 

section: develops criteria for. evaluating the extent to. which assessment 

information j is used i ima anendnet minatory ‘manner. * Be 


The Use of Test information in Decision- Making. net “y 
One of thesmost common abuses in assessrnent consists of using tests for 
* purposes other. than those for which they were designed. Eariié fer gn this paper it ; 
was, anoted that educators “use assessment data to make five different. kinds of 
educational decisions. We need to pagretatively specific regarding the kinds of 
information that legit: mately ought to be collected in the Process of making » 
differant kinds of decisions. tri agreening, our concern is for identification of 
those who are, sufficiently different from others that additional assessment is 
believed warranted. Screening typically sequirss both observation and norm- 
; referanced assessment. Simiiariy, .p placement and identi fication decisions - are 
a. _ Morm-referenced decisions. Educational personnel must be able ta document the 
ie fact, that a child is hand capped’ ta provide ‘services. Documentation usually 
~ consists of demonstrating that a chile as sufficiently different from others. In ; ; 
RUIN NING, Instructh nal, interventions, however, normscaferenced. dataare- useful. Sete 
only to the extent Hat they are task-analyzed.. Rather, as noted by.Satvia andl 
_ Ysseldyke (1978), ‘teachers want and nead to know specitically wilttets. teach 
and how to teach. Information of this nature is best obtained by means of 
currigulurn. based ar criterion-referenced asses sment. Evaluation clecis HOTS require 
“ee coliggtion at ‘ither | norm: neelereaced. (if one ‘is attempting to compare: pupil 


we 


performance. to a national: sample): or criterion-refer enced te one's ascertaining, i 
the, extent toawhich’ students achieve objectives) information. Once again, thé. 
‘over: a ding srinciple is. that, the. kinds a af information. collected need: to be a 
funct! on. of therkinds ofF Uecisions ane is making. ae os Sd 


, 


: * 
on. ‘ata obtained by means sf: curt ts lige: based’ ‘assessment. 
86. LEAS routinely. examine. the ‘Vater? elationships between. the kinds o data” 
: othey collect and the kinds 9 a Seesons they: make. 


Rk dear ; 


nee 


— ” 


jas inand Foiiowing Assessment - 


data are collected tor tha. ‘purpose ot rake ing 9 decisions. 
“Puls, and owen: those! data, are, collected _ _ using” ‘assessment devices» ao 


When: assessment 


‘feck 3 thar many caturally road ~ pupil characteris. 
“cs can and dio act t te bias the kinds-of ‘decisions made about ‘pups, LEAS Must 
take. steps tO alleviate the” axtent to which, biased decisions * ares ‘mad: Th 
probably 


jatearcs® dem: onstrates the 


felons canidiced primary. in Tn decgn al 
andi vidual ” decision. makers to rouunely examine < 


. decisions they make are free of bias. 4 eS 


a . ra stat oes 


“the extent: to* ns : the 


Ssioasmaking for. their decision- 
making personn a o GE os i. ° — : 
| 38. LEAs A ave sstablished!'p chat as ifor Sey 


37. LEAs Soide training wa obiective de 


: Documentation of Besiien: Making See : 
a8 48 critical that LEA personnel havea & sod understanding ol they ways in which 
lecisions about, pupils. My own experiance: warki ng with | LEAS 
- peisonnel yom that. there ara many-varied; apinions: regarding. the ways in 
, which decisions are made, but little data to supper thase apinians, Many LEA 7a 

personne! indicate, that pupl! performance, on psychometric” measures. Ys the | 
. Gritical factor influencing decisions made about those pupils, Othels § state. that =< 
puail performance on tests. is simply treated as. ‘One source of information i nm the 
‘decision maki iag Process . Stiu others. maintain that: test: based ‘information is 
“Seldom used in decision: canal, “thatthey go o considerably beyond. test'scores 6 
‘whole ‘child’, LEA personne! should. be collecting. data on.and .- 
maintaining records, regarding the decisi on: making process... “Decision- making 2 
personal, shqulel she required Oo proviie 3 very ‘brief rationaie: for gach: decision’ ae 
made, and d routinely the decisions smakiog nvocess should be studied. ae 


he 


consider rhe 


; 3 other forms, of 
‘ “documentation: regarding ‘those factors consiciere ad -primary -in decision.” 
0. LEA diagnostic: perso el. routinely, évatuiate, the ¢ decisiin-making process 
Sand: are able to iduntify the, ‘factors chat are regularly considered pri mary in 2. 30 3 
the. placement? inatunstional planning, anch evaluation decisions: they ‘make. nae ey 


wo. 


+ , eaeia.s y 
x . pe 


. Use | in deci sion aecnd are -techoically Lee Reliance opfscores earned 6: 
iy ; inadequate, tests-can, contribute ‘tremendously to, abuse in eee 
; aarti er” that. ‘some. sources: of error. in.a3 SESS ent can be > S* 
‘obtained scores focestimated | true score as. ‘ can. further: ma 

Sree. ert or ia sinter pratation ‘by reporting pupil performance in ranges rather oS 
: than’ in single. seotes. ! am ‘cominending that} m interpreting nah perfa 


ae src intorvald around those estimated true scorea . Proaedk ures. a for doing 50" 
are outlined in Saivia ang: eae (1973. PP. ‘BS. 88). : 


eu so ; an norm: ceferenced. psychometric : 
: Wak: convert abtiinat: scores to.estirnated true 


a face St - : FIGURE 2 Z 7 : = = =" 3 —o . - 
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modes of “communication” wherever “Rossible: -be _ ‘validated. for the’ specific 


ce 


: ~ purpose”: <hienanleteree: by. “erained. personnel in standard ways: airacied at 
: _ specific areas of ‘educational need” and not simply ‘at general intelligence: 
“accurately” reflect the: child's aptitude: or achtevement”’ or other targeted 
“factors. “rather: than “reflecting” the child's” impairment’ except where: ‘those. 
skills” are ‘themselves the target); never consist of a “single procedure” as the. 
sole: criterion’ . The evaluation “should also be made by a “mnultidisciplinary. — ae : 
: earn ; including a specialist: in the." ‘suspected disability. , And the child must : *. “ 
‘be asiessed in: “all areas ‘related to the suspected disability, ‘including, where 0 ss < 
appropriate, health, vision, hearing, - social and emotional status, general” a Ss : 

ss ad sacademic performance, communicative status, and motor: abi tities." 


‘6a. 599 deals aries placement procedures, er théndates thet the LEA shall Pe a 
; carefully. consider, inary sources of . informati on, including - “antitude and 

“2 achievement ‘tests, , teacher recommendations, physical condition, sacial or ; 
~ cultural background, and atlaptive behavior.” The teams must. include. persons: 
‘knowledgeable: about the child,"* the data, and the options. And. the decisions. 
“Tnust conform with the | “least rastrictive environment rules.” Any: pees 

_ decision must involve * ‘individualized education program” (1 IEP). SS Bs 


a 


ae Finaily, Sec. 534 esavides for’ sreévalubtionis” vat least. every ‘three: yerrs, Gut 
_. more eeeanenty att HM OnenH ORS warrant”! or if child's teacher or parent requests ; . 
it, : ‘ : *, rh Bact 4 ; ed - 


i 


B55 


 Seructure of This Honore Me ca «i= - 


@ th oe work is, organized into four chapters 10 vesbond | to ‘these guidelines . tees 
; above. ‘Sinee - ‘Fairness " in-a system axists far more in the decisions made than: in sé 
"anything else, “Chapter. Q examines what is. known, scientifically ‘of decision ; 
processes. ‘in general, ouUines the characteristi cs.of formal decision analysis, and ~ : 
sketches ‘out what is apparently. needed in order to make such analysis function i: 
> under eo Handicapper! Law, - ‘Particular attention is given to the central role of ; 7 

. ‘values in such decisions, and some ;ways: are suggested for determining these ; 


values: for such use. Here! 3 as in Chapters I and II} recommendations from nies’ 
analyses are largely saved untii later. 3 ee 


Chapter ue “gongiders ‘the difficulty af finding reliable and valid aesesaemnent 
‘methods for the. Handicapped. It shows the effects resulting from choosing any ~ 
‘extreme: cases by some quata, either. gf observed score or true score, and gives 
. pacti¢ lar attention to the ‘Vexed. problem of reliability for difference: scores, 

“sintce . “identification . of learning | disability involves subtracting ability from 
; “achievernent. And: the question. of reporting true scores for these differences is a 
7 e reliability” of ability” is quite different , 
from that ar ‘the specific achievernint, an LD “decrement” may actually” turn 
in advantage! Some suggestions are _ Made here _ for improving the 


aR 


- fort Chanter iV. The question at anpéal 5 is also ‘consideredtin Chapter hy, 7 
Chapter WW “touches on a “alumber of. vechnicat matters: aed to tha Law, 
peci rally. those concerned with “racial or cultural bias.” "Often interpretation of 
‘biasy seems most ies Sepene an ie “sources - of grou. chfference: and 2) 
ikelinood:, of remediation through differential treatment Therefore “same 
"7 ‘technical consideration is given ta the. questions af measuring heritabili ity, the ran 
= possible use of different ethnic norms, and ‘possi dle procedures for. guiding: the: Le 
“toreignstang, uage: student, with the aim of acculturating’ that. minority student 0 
“into the majority. 19 Chapter Tl also is.consideredt the: question of accessibility a 
el public peor. and the consequent problems of test secure Ree, “7 


: chao Ww" is designed to putin one piace ali the major redorimendations ¥ which. 
.séem to follow from the preceding’ chapte: The sefous Student. of ‘these 
questions, given both the nme and the techn nical know jedge, may wish 0. wade 
through the report, as the weiter did, from the psychemetri cexamination of the ; 
issues through the. _ summary recoramendations. A reader interested fanty ‘in 
* - Ceekain features “may: wish: to iconsylt the index at the report, studying those 
par tsin ‘partiguilar, and then the recommen dations at the end, For such a reader, 
"the index wwii ~ probabiy satye as an‘adequate guide. But for the reader who is 
-mainty interasted im tally: ng opin; Ons on these Questions as guides to conduct, 
“Chapter Wow serve by itset fe Since opinions wil diffarzhowever, from one * 


investigator Lo another. it seems very: ienpoetar aso gainer, fran Chapters tto Hb. 


some feeling: for the sart of evidence ani: reasonin 1g fused In » aeriving” at the. 
F “ = Soc — on 
“recommendations. . 84 . 3 a a : 

> ae . ge Fd * . 


Many have helped ts: studying: rhege a MESLIGNS. A». sarnes Yosaldyke kinct ty. 
provided papers he had. written on rerated concegfis ‘of thes Caw. My colleagues at 
the University of Connecticut, especially os. Isabelle Y. Ufperman, A. J. 
Pappanikou, and John “F. Cawley, have given valuable background in Special 
Educatl@p. And professionals engaged in theéchools, Mrs. Linda H.. Paarianen ‘and 
Mr. Joasephm F. Stano. have . helpfully. Ahared thelr own experiantes and: 
investigations. Especially. Or. Linda G G. Mgfra, Paoesuen Program Specialist with 
— the Bureau of Education for the Handicdpped, has, oge ther nigh her coworker&, 
ee POV eth. valyabie...ing sights. and_-sugagetions. for improyement..af. phe. eatlion2 Reena = 
thinking. Nevertheless, the opinionsfand conciusions expressed in this report, 
“together | with any errors: stilt! “pres nt in fact or. judgment, are entirely the. 
"sponsibility of. ane weiter. / “3 oO 


| a 


ae 5 CHAPTER I: - 
cA DECISION SYSTEM FOR THE HANSIoAPPED. 
o “ oe 


“The rnpleqeaiation of Public-aw 94- 142 requires that any decisions be ee: 
>. relating to ‘handicapped “Children by each participating LEA. These. decisions are are” 
: Sslarae and” “small, ater tha Rese ine hihi ‘the entice system isto > be~ 


e 


oY The LEA will! decide” ‘gout. = structure. of. a. particular program for 
classifying ane placing one treating youngsters; f. Sw 

é 2) The LEA wilt decide se Daou thé particular eligibility. rules tor a particular. 
: treatment program:: o 


v3); The LEA will deci whether a particular child should be. igsigned in a 
rticular : ar . @ <ae ee : : mS 
ee et oe ee Fe 
. This paper‘ wii make a number of recommendations about how: such decisions F 
; should be analyzed, and these recommendations will be in part based upon. 
: © psychometric: and educational beliefs; but also, to a substantial degree, upon. the : 
_ formal and highly developed theories of decision analysis, as used in the fields fig oa 
‘management science nd operations research, ‘Unfortunately, however, much 
Special Educators ‘have written: of “decision: ‘making,’ this theory remains little 
understood, If the reader is already conversant with.formal models for decisions, ” 
then he-may skip ahead to Figur’ 3. But.for: most: readers, | urge attention to ‘the: , 
, introductory material. Afiet i iNustrating the use of such decision models, this ; 
chaptér will consider. phe ‘central voridbles required for riaking such: models — 


ego! in practice, fi. : rr ae ae 
s AQ ods sy * Weg = * : ; : : - 


= fous 7M 


a Fs a . Fe eee . 
vite tee ee . f ; : : . : 
Discrimination and Educational Dedman: 


Jt is. frequently pointed out that “fairness” does not exixt in th, tests 
themselves but in how they are used; thatis, in “the decisions made on ‘the basis 
HF “the” citigy And when “we “Gonsider applications of “PLL 94-1427 we are” a4 
oo concerned that there’ be evaluations of the identification programs. and of the kas 
ee treatment interventions; and “evaluatién’’ implies, once again, the relevance of , 2s 
~ the. task to: some subsequent decisiorts, Indeed, in evaluations texts, we find “ . s' > 
frequent reference to “decisions,” yet seldom any attention to what is ‘known ha 
Ge ae ee Powe 978)- Sere SE 
Yet there exists: a large. body of work. in we well RET yy aiseipime~ots — 
“operations research (e.g. | Trueman, 1974: ‘Wagner, 1968), and there is 
_ particularly useful. and reaatly grasped structure int the sub- field of ) decision 


“analysis (Raitfa, 1968). ‘The charge from Congress’ anid 1 from the Department of a 
“Health, Education and Welfare especially requires the. conceptualization of a mae 

working “system in which ‘a myriad of decisions are made by LEAs and SEAs’ = 
affecting» ‘the: educational © lives of > the nation’ s: handicapped. ‘Vtis: fitring, 
therefore, that we explore the points of contact between this comprehensive 

‘ _ goal of our government, and" the impressive techniques of such decision analysis. 
= First, we shall design an abstract: ‘decision system for the implementation of the 
"Handicapped ‘Law. Then, we ‘shalt consider what sorts.of information need to. be 
_ genergted. in order to: ‘operate the: aren: with suitable prOTRenor agains: bias. 


_ Decision Making For ane ae 


ae is intuitively recognized by: most: pebpie- that rational ae depend on. 
estimating - eran variables: “probabilities of various eutedwles from the 
‘decisions; the hikety benefits; the likely costs. Note that costs. might. be measured 
one ‘way {such as time spent), sand the benefits. ‘quite another way (such. 
_as pleasure expected). Vet it is clear that: in practice, as individuals, we have little 
‘trouble handling these two kinds of value — or we cguld never decide whether to. 
pay. for a movie! When we come to: these problems as. professionals, however, we. 
“find only a trickie of research, attempting to reconcile such different scales, To. ‘ 
“motivate this discussion, let us. first assume that the values problems ig tractable, 
a and Look ahead to the advantages: Of a formal sywtern, 
7 “@ ; ’ : : 

Decision analysis may be thought of as ‘a saphistionteds elaboration . of that. 
intuitive idea about probabi ilities, costs, and’benefits, Any decision situation, ‘may, ; 
be thought of asa “tree”, with we top. nadie: referring to, Some imam mediate oe 
~ question, anid tae nodes below it aa to shbsequent questions. These nodes. 


“. areof two kinds, . 


: was on Ry. 
a. square nodes, denoting-decision, from which tHe de scending branches : : 

 .are-alternatie choices, mutually exclusive: and - f 
= circle nodes, ses Aen from which the descending branches . 


_ are alternative vents, muYually- excl: $5 
a2. z * & % 
NN Jae 4 o : c: 7 b a 


. ann e . 

These nodes may ‘caultoly into large structures, Dut. albamust eonlane to ‘the 

_ definition of.an upside-down ‘ ‘tree,’ " having a common source. at the top, and ~ 

. complete separation ofvalt branches. “Each of these nodes is: calculated septrately. 
beginning at the bottom of the tree: and working up till reachigg the top-most 

s “node. If the stru@ture of, the tree is a good match’ to the real world, and if the 
numerical values are. estimated well for each: part of the tree, then the decisions” 

' “are in fact automatic, and can “be: made efficiently: by acomputer. Error-free tree. 
: fa - design, then, deads: directly to ‘error- free decisions... “And: this ‘statement, remains’ a - 

ST tee-even when there -ace_large. doubts about the likelihood of future evertS— so. 


* a eat 


a 


= 


“tong as the gehabilrty est: mates.” “themselves, may pee considered accurate. St i, 
4 a further. claim can be made for the tree. Given the same human. ‘estimates of - @ 
parameters in the tree {the Steucture, probabilities, costs and benefits}, 
lant: — always match or Detter the human decision maker. 


“Figare ! shows» the simplest kind of decition node, and uae: haw the 
optimum 43 decided) We shail consider; here: and j in subsequent problems, that we 
c sare choosing among three. programs or “Plans” tor the administration of the 
| Handicapped system, We have estimated “Utilities” for the threes Plans, by 
methods. wee shal See: ‘The rule at any ciecision : node | is very simple: We.select the, 
Pian which yi las the highast sstiqiared Utility SOF the three listed Uvaldes (14, 
20. 44), 20 is obviously the maxirnum. Therefore maxitd, Ny U, = = 20. The value . 


Sof the ducision nade becomes 28, and the ‘two reject edd brancnes, Plans 1 and y . 
ae 


care "folded back" ,a- process indic: atedl by iva barrier lines-athwart each branch. 
fe ged : OA ' : — . 
As we Hae noted, the other Mjo- ty pe aft note is for ¢ probabilities, and we show 
a prgbabiiiy iy node in Figure 2. In this-iilustration, we are using the probabilities 
to astimate tne costs af measurement for one of the Plans. There are. just four 
ciassifications © of pupils here (for purposes of this Plan).Each classification c has 
itsvown prababili ty Dd. ane its own cost of measurement Me. We find the value ofe 


ere 


gacn M.. by its ie and sum across the branches of that rode. Thus the 


= id . . 
- yatiie of the’ node, a Figure, 2 is Sno. wn aS 3:30 of same appropriate measure. 


mo 


« . 
Whais’ the meaning of. probabil pty” as used here? eure lecisions in general, it. 
. aS may be of either clawbic.. kind: either based on subjective: prediction ias for. 
unite future eventswer based on jong-range fraquencies ‘las for the result of 
“mast experienc a ot even of same 3! atutory ) oor other a). The a 
mtifferenr tothe source; tut obviously the *probabiiity’ , ‘values VY aie > oe mach 
“more pracise- if the sytem mandates the distribution, as in filling classes of 
a “predgterminedisize. . Ot : Bs 


sts 


gorithm | $s 


ee / . 
For a more complete trae of decision” for the handicayped, what giements ww 


+ 


_teeded? We aré interested. in decisions: made on the Basis of evalu. 


stars, And 
“between. these hwo ands at the chain.we naed nlans iwhich wt f 


eaerer. selector abs. ciassification. lapolie d.. IO. Rds! 


° priate iQ: the classifie: ation), and Outcomes: DATTREn preacment 


_ Such a chain fs shown in Figurs 32 . am 


and 381 3 sation. 


a ‘assumed to be three piAans, “Th 

: systetr of fear class! figatians. af pupils. Ror the thir: a. Cia; 

three relevant treatments. And for the second, Treatment 2, there are three 
“outcomes. Thest three outcomes, carry the evaluations, E, c and Ey. Not that, 
by making certain other assumptions, two 0 levels of the me ce ald ne eliminated: . 

~ We could collapse levels {1 and tHE, Gf there were only One authorized treatment ; 


re second, Plan 2. hasa ~ 


ieation 3) there are 


ly his dilusteation” there gs 


x 
ee 


"this: probability. node: ‘by “'avefaging out” the descending branches’ we multiply aes 


| FIGURE 1. 
CHOOSING APLAN 


sy 
ae oS 


“DECISION y “Max (U,) = 20 
a . ; : . & ss wa 
‘ << Folding back 


suboptimal plans 


: 4 ae 
mee & ~ . 
. a = of 
< ‘i 7 aa | 


“UTILITY, UTP Ug 200 TU ta 


a 
: 


~ At the highest level, a’ rational decision: consists of selecting’ that plan which’. 
maximizes the estimated Utility. Those plans: which are suboptimal. are “‘todded > 
-back,” an action denoted by barrier lines.. The ' ‘value” of the decision itself pen. 


becomes the utility of the plan selected, in this case max.) = Us= 20.0 °F ee 
R Pa | 

* ame : ‘ : - eae ee: Sess “ an iti ai 

\ . 2 
XN 

2 

. ie 

i 


"\. Classification’ ug) 


M,=2 


aS 


pMo=(.4)3 + (124 (3)6 + (.2)2= 330 © 


. N 


. of f 


. es : 
. ‘ . 


iu decision analysis each - probability node ray be* calculated, whether tor” 


sf 


Hi Treatment, 


'V. Qutcome ———_4__ ay, 


Ce ON FORE ER Ne ams 


EVALUATION . 


e.g 


“The decision. is which of jhe programs or aiahes to ne ona system: -wide>: 


oe basis. To implement the tree, the system needs estimates of the evaluations, and eS 


_ 


. the. -probabilities. of thiee levels’ in the tree: pupil classifications, treatrnents for 


- each Slassification, and outcomes for each treatment. (See the foltowing pages. 


fot iMlusteations. Jy 
t 


Be 


“°° PROGRAMMATIC. -g : 
iL aac TION OF eas TREE 


“Figure 3 wilt ‘be, perhaps. better understood it ‘fleshed. outwith atusiiaelve . ies 


“ Bfanches-for, decisions and. events. ss Fperatore | ‘let us. say that the. levels of | 
: hace are as s follows: oy 


DECISION. There are just three, plans s being ‘consi dered by the LEA tor: : 


admiristering the Handicapped“ Law. These plans, let Os say. “have: some 


: i major. differances in structure. iwhieh: <will nat be detailed hece), ‘and the’ a 


LEA ‘theretore wishes to avaiuate. their potential, aie «, and choose . 


one of them: . : re a 
. * z 7 . sae % 


“LEVEL 1. PLAN, We shali timely call these: Plan’ 1,-2°vand 3. toavoid-a 


cumbersome sketch of ‘each. 
LEVEL hi CLASSIFICA TION. Hera we assume four ciaie - 1 general 
; identified students. Far simplicity. ners are: : 
, F physically impaired: - 
2. emationally disturbed;. 
i learning disabted; 
: eat ‘disabled. 


LEVEL “un TREATMENT. Here we postulate three treatments (at 
: alternatives for any LO child: , = : 
st, requiar cla: sroom ; 
“2, Sine special education cliaoarn: 
2 molar classroom with resource room n Blacemeht. 


% 


‘Lever IV. OUTCOME. Under Treatment 2, we “here assume three’ 


posite outcomes {as measured -} year taters: 
* 1 move to regular classroom: 5 
emain in self-contained sp 


ante Nain yet nett ve 


. move: tor resource-room treatment. 


EVALUA TION. The decisiort tree requires this most important tevel Gh 
evaluation “ot the three outcomes. possibie within this treatment, 


- classification, and. plano. As here presented: these, could depend art: 


assessment of pupil condition implied by the sutcomes: or couig depend 
_ one weighted sums of eg as or oer measures las in the-.“‘bentee™ 
satay to be described). . a vz of 


"Note: ‘Asterisk marks the particular aan through the tree ihustrated in 


ir the Figure : 


Pa 


Naina 
» EL Te TION OF DECISION TREE 


.) for a sei ecti ian. of programs. Within hae: - 
~tlecision, he pupil's ‘Giassi fein are treated as probabitistic ! Avents, based! 
“ore either “past or prediceted’ “tong: run averages: o ot such. classifications, 

‘treatments, and ‘outcomes. For the’, individual pupil. however, the nodas of. 
this tree may often change fram orp bapiistic te decision fodes, For 

‘grample, ance a ehiid is class fied as “earning disabled” isee LEVEL Ah 

CLASSIFICA TON of the breceding page}, then there may "be a sub-t ree of 
J the follow! ng sorty = ; r ri ; 


Gutcomes ara! 


7a mnevensta reqailar Jo 


Zo tarmarcoin gadis: 
A 


nen EN ATI om ete 


PONT? 


choice, will now be different tor the individual trom what they were for 
the group as a whole. Theseswell again deoend on past experience and 
furure  pradiction, but now, verd upon anes student 8 intial 
profile. _ 


| 
! 
{ 
. So. ta thas illysteation, the probabilities af Sutcome, within vagh iihatenent 


tate description,, but would itself be the namericat evaluation. 
gure 3 may: be better, since’ it makes these actions: more explicit. 


- 


But the ‘tree ys 


“could: ¢ ‘occur, or, “whieh vould’ be-ordained to” ‘Occur a quotas in. the: system. : 
Thus, each node, ‘below ‘the: top" would be, donna out,: “sbebinning at the 


with: the largest ipecetie all things: considered. The aigebrs ae value ; 


PI 
as for each node is: ‘suggested: By: the summation operators’ ‘to the rights woe 
of the Figure. ey. @ 3 or a 4 a 


- , re, | ae es i ‘ . 
‘Calculating the Utility of Plans - o  * ga Nae 


: @ we wish” to ‘understand “the ® structure of ‘the systern Trina, difterents 
es perspective;:*we turn’ to’ Figure 4° Here we have said that there are. just’ : 
“three. classifications, five. ‘treatments, and four outcomes, so that: our. ee 
cmatrixshas 3x 5 x 4 ‘- GO ells. Some of- these would-By efpty: tf a pu 
‘diagnosed (classified) as gifted, he ‘is unlikely to. be “prescribed Atreatedi -a3- 
. Learning” Disabied. Furthermore, the “outcomes’’, as we have suggested, might 
: be. transformed into some appropriate. continuous variable (more of this tater), 
_ which would. turn the matrix into just two dimensions iclassifications by 

'_gtreatments) within any sitgie Plan. But in this iMustration, there is. an, 
-* evaluation, E,,.. for each meaningful cells’ Thefe will -be mort about such | 
7 evaluption, too, , 


-” But. we are going to select a ‘daciaen in terms bi. its senses aging” = a ia og 

general term from other disciplines meaning. thé. attractiveness of a choice; the. “s 
units are not constant across studies, but may be designed for a situation, as we 
~ shall see, For the present, let us ‘assume that we have-such'a measure, Then a° 
.general formulation could be that Utility is equal.to the.benefits, less the costs. 


For a. testing program, there is an. excellent, seminal work by Cronbach and 
_ ~"Gleser (1965). which considers ; a pre program ram much Tike: ~that “ot Figure . o in ‘in which 
othe principal: cost to: be considered was the cost ‘of measurement (p.24). Fac such 
a p program, Utility Would be-equal to the overall evaluation of the. pragram tess < 
the Cost of theasurement within me. Progra: .Formalty, we can “set forth the 
algebra as.in n Figure 5. ; 


sGeaniall: this level of expression may seem overwhelming to many practitioners : 
in LEAs and SEAs, and it is not suggested that mney work directly with such 
formulations, But creating complex trees is easy computationally (e.g.,Findler, 

‘Pfalz, & Bet s(ein, 1972), anc computer . aids to decision making could lend 


FIGURES 
THE EVALUATION MATRIX 22 ae. 


2 . . * 
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TREATMENTS: t 3 


soe CLASSIFICATIONS a: ia ~~ 


a ‘ ? ‘ 


ma ¥,, a given plan, it is possible to. construct a threg-dimensional matrix 
“according to pupti “classification, the treatment alternatives for a given y 
_ Classification,-and the predicted outcomes for each such classification;treat- 
~ ment. combination.. For each feasible cell, one evaluates the outcome. 
“considering both benefits and program costs. i 
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: FIGURES ©. 
CALCULATING THE UTILITY FOR A PLAN 


% a 5 : 3 n 


CALCULATING UTILITY FOR A GIVEN PLAN. 


. The overall "udltty” of clan may de given by the formula 


> 


e. aN 2 fom. 


Porte: 


K 
Zz 

“ey i. 
no) 


where . O, © the orobability of the ith event, 


‘Us = utility of the plan 


4 
fi 


: umber of: dup pils for whom, plan is designed, 


c= the pupil classification from caeasuremesit oor 


~ 


it 


the veatment selected, * - ‘ 


‘0 * rhe outcome feden he tregtrmart ‘ Me 
oe: F >» & = hee ahiator: OF the oth outcome, oe 2 
: . . A = the cost of measurement for the cth classification, 


The value et Lis détpandert on the benefits, fess the casts, and therefore assures - 
construction of a single scale of rreasurerment, a 


t serious problem with ‘implementing such algorithms in ducation is: 


; “probably ir inthe Suaneny of. reasonable values.’ ‘And it is to this problem that 


> awe turn our ‘attention, 
ba > Ss i ” . 


te 
ee | 
AN 


= Uses of Ae research have” ved most in. a Figlds where there. was a. 
common, ‘agreed: upon méasure of utility, such-as doilar profits, or distance ané_ 
time costs. In education, we. ‘are often. thinking i in terms. of educational benefit, ‘ 
with no unit, or. scale readily available, Consequently, vlarge major types”, of > 8 
problems. fare ‘simply without any “investigative, apprcach. ‘as commonly. uider- _ 
* stood, Some works have treated decisions, within, education, but ‘have ‘side- 
gtebbed the fundamental auestions of’ value (VanDusseldorp, Richardson, es 
“Foley, 1ozt).. Othe rSs shave deeply analyzed the theoretical. considetations 
: » cunderlys ngi smultidi mensionat and curvilinear value systems in decigon making, 
but nave | “few an plied suggestions for “educational practice (Keeney & Raiffa, 


1976; Wilcox, 1972), 
” Le fg 


tis 


i oe 
“Part of purty: weakness int 


; adersia Ack nyo complex vatuess he obverse side: of one 5 aa 
of aut strengths: oor sophistication: a multivanat e aoe where : was discover : 
apprepriatel weights for optimizing a prediction.. The ‘problem. in evaluation “>. 
beg! ns at Re other end: rather than discovering. our value-weigkts, ° wa invent 
<* aaa THe ulrienat e yalues are dependent an Some -quite — tive process: the: 
ahve 


eciedisien situations. Yet a é en ‘review a ‘ecnivaess for aut - 
aR seuremont fag... Cooley, 97H, oni take "ng notice of the apriori values 
~oneecied for decisions. eS a pe Se ‘ . 


. Te. meek this froblem, we have. atternpted-to create a scale of overall! educational... 
benefit, We have begun by defining aunit of measure df such benefit, expressed 


3 asa ah Cure of e e ducational accomplishment, scated in the usual way with mgan i. 
ara dey TOU Scores, then, rapiae from about 20 te about” 
sf aie T. scar a," "ar bentee, 4a Funcyion of ge weight ad sur of t 


tron ai 


' Fy 


ain n-variables sauttioliesd by. their medsurements for can individual or 
Group. Ski cicey if the total ak ie of the ines for a ighsehoat senior is 


welues of cer 


“taken to cor 
: Science, arts, beim an personality, we may display: hace as branahes cay 
the bentee node ach may be in turn Bronce down, Such a reais shawn in. 
" Figuee 6 > 


‘ . 3 


Tht tee. hag-sei ey riiarkabile idatures {as described by ? Page, 1972b: Paue, 
1974b; Page a Breen, Eel fe borrows many of the: “ingthematical Aealiage ot 


_ FIGURE 6 
“TREE OF EDUCATIONAL VALUES 
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‘to expert opinion, and from rues “space to test-space- ‘ 
& . 2 


e. 


he probability: trees. we have been examining:: “The values for gach, ‘set of. Paes 
“branches. may be made to sum to 1.00 for any node, Then these may be. 
a roultibied down the lines to calculate fhe bentee for'a deeper node. Values. 


where. they are repeated: may. also be summed for a total appraisal of the value of. : 
; a on noawledey: or skill, Ee 


x * 
eS : ahi ‘ ys, 
oany & : 


7 


= The. most striking quality of the: bentee tree, however, is- its philosophical » 
_gompleteness. Within only a few generations (seven in this illustration), one may .. 
-“move. from the ‘top: ‘level philosophical values. for spciety, the systern; or the 

individual, down through successive divisions to the. lowest; most direct test 
“Ttems or specific behavioral objectives of instruscion, It provides, then, a way to — 
“= subsume much’ ‘of education within. a single system ¢ ot value. - 


~ 


How to perform these evaluations, then, becomes at concern, and the: answer: “i. 

- fairly Straightforward: _In effect, we have appropriate judges vote on ‘then. 

~ Various: inethogs: have. been investigated by researchers, and we have given our~ 

~ attention especially to two; and one of these survived as more convenient and - 

Tess. expensive. Ri is called the token method; and works by asking the. judge to. 
“Spend” 100 tokens arnong'a.number of alternati ives, according to the ey he. or 

~ o she (the judge) feels isa proper apportionment. of value. * os ee es 


x 


An peo, als) stigation ‘of the waives $0" aisigned DV 101 judges’ ‘thalt 
“ prof€ssional educators and half laymen) sh8wed Wat, Wy general, such allocations. 
of value-are made. quickly, without apparent strain. Furthermore, “despite wide. 
: individual differences, there was a clear agreement betweén the: ‘educators and > 
the laymen about the top-most. values (Page & Breen, 1974). These. findings were a 
ate. 7 "partially confirmed inan applied: setting with the US. Navy iPage, 1976p). but. 
earn certain artifacts of judge behavior were also non. In another, more theoretical. - 
article, it was shown how such tokening could be used in “the, ‘design . Of : 
. Curriculum (Page, Jarjoura, & Konopka; 1976): Of. ‘course, as subjecti 
"judgrnents; such a tia are vulnerable to the same ‘sorty! “OF variables. whi 
affect ratings, but ‘they -are no more: vulnerable- than: ‘such “other - SY) 
processes, and they havé the great virtue of being out in the open, where'the 
: may: be appraised for’ reliability and tepresehtativeness of some target population 
of judges, In addition, use of the bentee. sstrategy pe mits ‘the incorparati 


a. ithe” ‘vaties into ‘decision: “making ‘algorithms: which are, ‘lnder. Certain ‘assur . ons 
— error free. In short, such a strategy eabploys subiggtive judgen 
_ and limits it to those functions. wtyere iti is irreplaceable by objective 


& 


oy Values for the Handicapped _ ou. 


mm 


. nee US consider” some cases of possible ‘decisions affecting the planning for 
S Sardicenees. Car ‘ ” ety mt Gg Pac ae SO 
6980. 7, Despite a east restrictive environment” * ohrade: the absorption of the > 


physically chee Into, regular classrooms will clearly, have liabilities as well, 
ges. » oe “on. me nature and severity ‘Of the “handicap. Niele 


6 oot ee 


normal majority. How ay such hitosophica and eolngicslaventions 


the “Federal Goverment within. ihe provisions, sof RL. 94. 142 rei is: ene 
to believe’ thera wil be no rits tg such support, from arty source. But Shére a are . 
‘many © ‘more: who, “depending on the personnel doing the evaluat) on, could be 
my need of such remedi anon. They vary widely tn type and degree of 
ical. sensory, and the entire range of Learning Disahitities as defined * 
“bys aw, ere are: ‘of course. Warigus,. as cae interest. \groups, such as. 
eels parants.:anc: specialized personnel, al of whom ‘have their particular | 2 
cORCERNS | ancl who ‘bring as. much pressur as possi oe on tha decision makers. As . 


, ters” any mare profess Fond! and ; More Promising ‘maihad of atlocating: the a 


‘claimed 


* resource 


Case 3. A.number of students, of aopfarent normal aptitude, are helow: ‘stancars : 
: ine noth: English cand math. A proposed niath program wou td from best 


Oe 


get 


tenates, raise math performance by four points lin Tacores) Quer the present 
“Sp rogram. But the time would be taken from. Enaish which would apparently 


ose 2 WO. points. 1s the combination aes -anclloss desiva 2 or undssirable? 


ts 


"is overused, Butis each of the three cases it seems reasoMable 


eis acrsig — ar at least. diiamma — about the leaitienacy of any 
{Administrators will come to same decision, 
tat jn moment: 


“il “oy ‘he 
: Take decisions unpopular with many, and: virtually impossible ta rationalize. 


. Note, that in each case there is an’ “underly! ng question of fairness to the pupils. 
isions must be > 


arnied: therefore, any use Of Lests int arr ping at such ede 


evaluated’ ra terms af protection against discriminatory misappligstion, 


a Pitti the handicap in ‘perspective. 

The ‘tiyst urablem is to put all of the pupil profile, not simpiy his aie at deficit, 
‘ain the dec ision framework. Otherwise, it will be very difficul: to make any 
judgments concerning nrevted resources, and competitive. handicaps. Thus. an 


240% 


em tt * - 5 a ON es we 


~ the basis of values established beat or takpn from: 
_pentge es: (dr “some other scale for combining scores) ; are: “calculated ‘tore a 
“te ust cal this combined score 8. forthe 2th & : 


aa 


rested WP is. Clear, ¢ 7 a 5 onnersly way! it is improvement in a 
2 
ar our Shasdicoped students efare we can make ‘da sions ‘about our system 


; we need? some estimgte® of the ‘probable, Success - oF our ‘methods. For. our’. 
{Durposes, Wwe especially “need ,to- know how much: im ovement 1s expectable in 
OB. “depending on the: ‘level of-effort expended. Diffar it handicaps will ° course 
“Tequire: “different: sorts of: treatments, 30 the: meth ds ‘themselves will not ‘be 


~ comparable, But most of these “treatments will spend’ a common ‘and limited! 


: resource: ‘the professional ume: ‘copperned. For Mustration, let us set aside other |. 


a costs, and agree that we have a total time T avaiable for remedi ation, “and that 


. 


we shall spend + ame for each h pupil, t.. “such that» 
; ow 


ra pee : Ss ipats. 


ra ~ 


“For each eudent from the-best in formation we have available.-we may estimate ~ 


the values, ota production function, like that. ‘one shown in Figure a 


This. gure shows an assumed. relation between t a Spent on a-student Aine: 
“remedial work) and the progress . made. ass sumes that tnree individual 

parameters describe the curvé. The formula is that t of,a fairly. familiar growth .. 
curve (9. Atkinson, 1972: Page. 1973): aan 


~ Dentee score’ for student: / at time he 


thaxdimurn Doss. ible bent: at Studertt i, 
assuming allt time T allo arred to him, 


=" starting bentee. of student » befor re- 
extra time is sper nt, 


“SRE base of the natura Hiogarithm, 


= vou finction for student i, 


At the time of making a ae cision about U me alec ana on. we will have N students 
-aligible for some help under the Law. For each we are able to estimate BO), 


othe Gurrent bentee betora beginning treatment, on the basis of testing. ‘We must” 


~ estimate Q.. and B. either from data on Others with similar type and degree at - 


handicap ene abet growth histories with treatment, or-from the data collected 
on student rs improvement Rem the first hours of intervention (the- procedure... 
suggested, by. ‘Atkinson for Arete ~qrade: reading ‘work for disadvantaged students). > 


ee 


: RIGURE7 sO 
PE RFORMANCE AND RESOURCE ALLOCATION | 
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” Measured in overall terms, performance is described by ‘the bentee B; {t) forthe 
time allocated to student i. Selection. of time allocations (tf) for each pupil would 
; depend on such esirusted sown functions and o on the philosophy of the system. 


Once. haiea: eirued the growth dive each aidan. we now have the - ‘ : 
‘opportunity Of: deciding the allocations,. ‘according to the system's philosophy. It > 
st now. ‘Possible, atleast, to state .operattenatiy what goal | is: being pursued. Let us.- 
look at.some alternative goal statements, with an eye toward the “fairness” Of © 
us allocation: 


Goal 1 “Maximize 38, 40), This. moulds have the effect of predodng the: highest - 

omean ‘performance! for: the pepulati te of interest, It would probably. imply _ 

‘neglecting ‘the lowest achievers, and) “would: surely mean. neglecting those, with. 
: ‘growth parameters cae - Therefore, it is sometimes termed an “elitist” Ng 


~ : : ee . hs 


GOs “Minimize the \ variance , of 'B. At), ‘This: would tend | to neglect ‘the’ most 
: ‘rapid | learners, those most ‘apt to benefit. ‘from the. system, even ‘arnong the. 
: handicapped. ‘tt would be: apt to neglect the slowest gainers, but would otherwise 


. emphasize- help ‘for those with the lowest beginning scores. - This is sometimes 
“termed ' “egalitarian.” me ant * 


Goal 3° ’ Maximize: the ° anausion of. students with: low input t scores B, (0) This 
woffa ignore the individual parameters of. ‘possible grdwth, and: ‘would instead 
scongent trate on. “those with poorest: ‘present ‘statu’, regardless -of” probable gain 
= from. treatment, This choite is not often articulated, but seems to be-close.to the 
*! Spirix. of some citizens and lawmakers. This might ‘be called a “compassionate” 
a approach. ; . 


- 


“3.Goal 4: Micimsiee: the variance to te This. would ignore all “the ‘parameters of. 
ee growth, once the pupils were identified as. handicapped, and would distribute the 


os time, equally ‘across .the pups. " Goal 2 is: “egalitarian. in outcome, then this is 
. “sagalitarian in allocation. . . 
N 


: Goat 5: Maximize ~ B (t), under the consrsne that each identified handicapped 
". pupil will have some minimum gime ki. th. ‘is the average time available for — 
each handicapped pupil, then k is some’ ee such that every ‘pupil will receive 
at least k of this: average time, Beyond that minimum, the resources would.be _ 
“allotted. to those who _ would most.gain from.the-expenditure:--Goal-5- would- have 
the virtue of. continuing to monitor and give some attention to each pupil, while 
* concentrating on those .who te believed: to” be the best candidates for 
, remediation. 
‘Undoubtedly there: are “other feasible ae as sapell These are not given here with 
: the intention of. deciding which one is “best: that.. is not the role: of a 
— ‘psychometrician:: Rather, they are presented as ‘an attempt .to recognize. that o 
variables need to be taken: into ‘consideration when decisions are made on the ~ 
basis, of test information. tn this analysis, the “fairness” of an individual decision - 
7 would appear to depend on the “fairness” of the. ‘system: We should: recognize ; 


that resources “for remedial education: will not tbe’ without limit; regardiess. of the 
levelof governménie Thus, the. problem. is-inevitably how to allogate those 
resources which are available. And itis difficult to imagine any reasonable: _ ie 
system: “which (does not recognize the ‘informational needs which have been 
“exhtolted BY’ this analysis. - © 


The Complexity 0 oF thie System 


af ‘those used’ to customary oor: the dettane tor inonneten: may seem 
excessive, and the difficulty of. the algorithms, compared with what-we are used 4 a 
ato, may ‘seem. severe, : ‘The. ‘response to these objections goes like this: Exactly 
a “which goals are we currently trying to optimize? And: exactly wnat information : 
do. we ‘need in order. to do -so?: And. ‘just how will. such. ‘information enter the a 
VTavstemy? This | response emphasizes that. there is no alternative’ theory of ‘tational 
. decision | making. . -Anticinated benefits count oasgeneral ‘predictions . about. an: 
“present and future: status of pupil’ performance. “Utilities count on’ value. - ~ 
“ welightings of. anticipated -benefits. Decisions count on: some balancing of utilities. - ae 
against costs. “Student” selection. counts on the’ principle of optimizing some - 
“function: of” the available variables. “Lacking an alternative. theory: ‘of decision SS 
© making,” we. must. recognize. that, without the prior information available to us, 
_we.are currently making judgments. which’ are ‘unknowably: sub-o timal. True. as 
Tilett (1975): found in: a comparison. of current vs. optimal teache., 
good ‘professional: ‘decisions may not be very distant from optima! ones. Yet the con 
absence ° of - such. information renders eo any attempt at. ‘corfiprehensive ae 
= evaluation. sy OE 


“Furthermore, there are reasons for. optimism in such applications, if we. Took 8 re 
“ the sort: of complexity which is now handled in ‘artificial ‘intelligence systems 7 
{Minsky & Papert, 1969; Slagle, 1971), large data-retrieval. sets (the Nationa . 7 
‘Longitudinal Study), and the massive rmathematicai Programming systems which ; 
"s gan.optimize a thousand variables. Granted, rnore.investment will be needed in 
7 such ‘applications to educational decision making; but the additional sums,. 
needed for, research. and systems engineering, are very small compared with the . | 
expenditures. ~for...the-application..ot_P. L. ~-9421.42,. cand. even. for... the_testing... ence 
; proganss ane committee operations necessary to guide t those applications. _* 
oo Above. alt, ivi 15 necessary to recognize - that human ¢ cognitive e ‘systems, whether of 
the individual or committee decision maker, are simplyunable to. compete with: = 
- “effective algorithms. Hitis (1971) made this point: very well in a review of the a 
ae literature: on what is’ often called ‘ ‘statistical vS. Clinical prediction.” His 3 _ 
a conclusion an “this point is worth: noting at length: : , 


“ : 
- q 


‘ ul yt expert judges are to be ‘used in the selection: process, present data. suggest . 
that they not be allowed? to make the tinal evaluations upon ‘which ecto 
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r = nature: of ‘these decision systems. assures: that. the! Law. 
rec that “no. single procedhire” will’ constitute’ the" ‘basis: for 
es, in the Handicapned SOM: , a 
Relevant. 0 this: question ‘of values i is patie. operation ‘of thet teams sof professionals : 
e called: CETs‘or “PETS: These: ‘teams ‘may ‘be ‘considered: ‘anal alggous: to juries, when = 
‘ one. AS: considering ‘only. the classification decision: and this relation i ‘is: explored’ in 
Chapter. W.Other ‘questions. of decision making are: dealt: with. in Chapter. Hy: 
Beifngtity: devoted to questions of f reliability: 
‘Material in “this. chapter has. had. to be often quite. abstract and general: she some 
oft too ‘technical for-most of. ‘the decision-makers in thé schools. It would: be” 
very ‘inappropriate, however, ta ignore such, “material. on that ground for, “as. 
Dewey: putit, "A good. theory is the’ most practical. thing-of all.” And the theory’. 
of: decision ‘analysis; ‘considered mathematically, is. demonstrably sound; in fact, 
there is.na. respectable alternative ‘theory about decision: -making.: Yet to take 
advantage: of such reasoning, it is not necessary that everyone understand it: “any 
‘more. than ‘one. “needs aeronautics to be a successful’ pilot. tus necessary ‘that the 
more: techinical people: ‘contront such. aids and study" them: shard: for: their 
oi in pouceuon: 


| *. CHAPTER He wot 
_proseniso OF F RELIABILITY FOR THE HANDICAPPED. 


sich: “reliability from: the. ‘most. classic perspectives, and ‘then’ ‘looking, at. the 
‘implications tor the special sorts of measurement required ot the Taw. : 


. Sey 
= 


with ‘the “observed scores, har with ‘the. " ogressed! “true. “scores,” ‘based ‘on 


: estimates: of: ‘the reliability at the. tests. Let us consider some of. iad implications & 
- such: policy: et an woes x : 


Let. us s imagine whe cleanest 1 data’ for ectimatiog the reliability ofa test score.” Sth } 
case. where, we. have two. forms of the test, assumed. to. have been: random! 

drawn trom a universe of, test: items, ‘such | as pictured in: Figure 8. ‘When “the: 
forms: are given.on separate occasions to the same set of subjects, there will be: 
Orr ation: between: them, which we: term "ag: Of course, ‘this relationship wil 

be.al fected ‘by. all. of the many influences bearing on. test performance. (Stanley, 
1971, “p.364): lasting, ‘and, general characteristics, of the dad Naat but 


temporary but specific characteristics of the. individual. (such’ as. ‘comprehension 
of the soeeiti¢ test baste) ‘systematic ‘or. r-chancelfactors: affecting the administra: 


aot, 


= test form 18. assurvied. to ‘be: a ‘random sample from a universe of test. iterns. 
encerotn the # ability « or skit measured. , 


oo the | content of: the t two. forms. ARathieg “the content is: sdienilar os 
because: ‘of: “the ‘bmogeneity ‘of the universe of. Rontent. from which they: melee , 


curved. line onnecting “the twa. test. ony denotes a sfelatignship which’ is <only a 
fortuitous, in being a reflection of their common Source. In ‘such, a case, as the. : 


wes 


: The ‘Biss path trom: “the, true. score Lo the. score’ ‘on either test ‘form. ‘then, may : 
 peestimated as Vey ‘This has the: result thaf, in ‘standard fors, 


2 2q*03y 24° vege : 


However, when we are werking ‘only . wit 


true scores will have.a smaller. variance than the: observed scores, because of the, 


a “removal, of error. That is, according to one definition of reliability: (Stanléy, : . 


1971p. 374), ee ee 
ia 2T .. hence é = 
eo ae * 


that. is. _ the population. cordaton between forms is the ratio of the. true-score 
hance to the total observed variance. iG convert the true score to units of the — : 


bserved score values (such’ as are 
expressed in T-scores, grade equivalences. etc), then we must remember that 


ae 


: a FIGURES” = 
~ PATH. DIAGRAMS FOR RELATION: 


_ BETWEEN TWO: TEST FORMS AND A 
oe SCORE: FOR ee TEST - 


~ Any relation” berwaa che two opserved test scorey’ such as ry 2) is caused by 
their common relation tothe true score, since thet are considered samples of 
the universe as in Figure 8.: Thus, the path of cs the product’ of the paths 


or a and b. Therefore the relation of each form to a true score is the smuare: 
oot of the observed inter-form ae erent: 


. 


in. much: ‘of the discustion’ which follows; we e shall be assuming, some: ceunott® 
a jated -by the limited. resources. The: ‘word.’ “quote” is currently untashion-"~ 
i “must. ‘be: recognized: that, ina field - “as. fuzzy as learning. disability, 
there must be in fact ‘quotas, whether: explicit or disguised. Estimates. for ‘specific 
Soe reading disability,” for example, “range from 2% to 20% or higher. It is obvious 
that, in fact, hardly any student achieves. his/her. "real ‘potential.”” To give « 
statistical analysis. someconoreteness, then, lL have often assumed a quota of just” 
2%... ‘tn: practice, this. will be larger . ‘or .smalier, depending. on: the. nature of . 
handicap, the expense ‘of the treatments being considered, ~and the budgets of . 
the: supporting agencies. In’ the tollowing, therefore;: the "2%" - should: be = 
; considered only illustrative. 


+ _ 


In case: (a), we assume a quote selection including: just ‘the bottom two > percent: 
of | the ‘population in-our remediation. Ih such a case, transforming to true. scores 
has no effect on ‘selection, since under: linear transformation there will be no" 
set in rank order ot any selected. : . 
“16 ‘case tb), we. assume the’ ca condition. sncbick wotla rd true-score . ‘ 
transformation “tmeaningful: that it will change the composition of those selected’. é 
. for treatment. We - observe that, with a cut:score in terms of. ‘the: ‘observed: 
“distribution, the number of those selected can be drastically: altered, depending. 
;on the. estimated reliatility of the ‘selection test. Inthe Figure, we.have assumed. 
-a reliability of 70, which. under.a normal’ distribution implies. that virtuatly no . 

~" true scores: will appear to merit such remediation, With higher. reliability, ‘of : 

“course, more will be selected, and with perfect reliability, thé true score will-be | 

‘identical with the observed-score, and: me same 2% will be selected in: either. case, 5 
‘For selection purposes then, tiansformation to..true. score “estimates does. ae 
5s bpaae to cake. soy tikleene | (though it Tight be a healthy | practice. i in its. 

a melon the attitudes of the personnel. involved), when we-are fonsidering: the © 

case of ; asin je test fora asin program. : re 


But. one. further case deserves. notice: switieth we.are limited. (as implied by: P. ‘. * 
94- 142) to. ‘some quota for all disabilities combined. In such a case, where we are 
using cut-scores: for ‘inclusion, the. nature of those ‘included will be partly a 
‘function: of the reliabilities” of the. selection instruments. For. example: hin’. 
* Figure 10(b); we had another test for ‘another. disability, and this second testhad wt 
a reliability of 90, then we would include more. students diagnosed ‘by this 
second; “more reliable “test. in a “sense, this would realeuate: to the met 


| ee OF Le 
AN.USE OF TRUE: SCORE ESTIMATES: 


trie scores: estimated 
- from observed scores: 


“(ab A quota Seechon “the bottom oe 


observed scores 


“true scores e: estimated > 
“from observed scores - 


a. 


stb) A cut-point selection: those whose true scores 
are estimated below -2 Standard deviations in 
"observed units: 


FIGURE MW. ae 
TRUE HANDICAPPED AND 
al heg CUT-POINTS 


True score’istribution tor an observed: ‘score 
vcuk paint : 


, tb) Two types of-error: Selecting “handicapped” who 
ot. Ribetede score are above cut point: ar faiting to” ‘select 
“MRandicapped who are.in true score below the cut 
point. 


e 


“Depending 6 on-the t reliability “of the measure and the extremity of ms cut ‘point, 
errors will be — of aca and exclusion. _t : e 


chi racter tics. some. or the” judgment more * properly: relegated to: social 
educational considerations. tn this: case, too, transforming to true score estimates 
~ Creates: as: many problems ce it seems to solve, : ; 


mportant trait, Theis woud ‘be identified as fit 4 candidates. for. “special. 
“remediation. in those: specific disabilities, ‘Under. muctr icism from: profession: 

ts; the- formula was abandoned, and will not be fauiennd here. “But the problem we 
‘rernaing with us:. “how to select among those otherwise “normal"” youngsters the... 

y-are victims: of. such an LD. There are three sub-questions: 

dow do we. know the: students are.’ normal"? How do we. know. they: have ace 

“specific. disability’? And what) is the meaning of ‘any ooeetebpaey™ between ae 
these two conditions? All are e fraught with Problems of unretiability.~ 


Said out a ee in this context (Ysseldyke, 1977. ‘Salvia. 8 Clark, 

972), the meaning ofa difference between’ two scores is. dependent on: the. 
“correlation: between the “two: tests: the. reliabilities of each; their standard - 
‘deviations;: ‘and any: ‘differences between the- original, samples” used tor the 
*norming. tf we convert our. school data of interest to-2-scores, then we are stil 
s concerned with the three coefficients, and are anxious. to ar noWw how ell moet 
we may put in the difference, 


Suppose wer ordatn a policy ae we are including: only poe ‘who faves an 
-achievernent. 1.5 @ below their achievement: include student / if D, =! S: What . 
can * we. expect. the distribution of D to be? In general, the variance ar a> 
saliterence is going to be | ‘ 


SS og oye » 2Gort, aF 


—Where-we- have-2: sages ue aye: ol =} herr tS” forma ‘ceconee 
ae = 2:21, 22(1- - 
if the correlation bee iAierenen: and ee is in the moderate: range. says 
.50; then, oy" 2a4. 00= Oy. .50,; “we would: expect.acut-point of 1.5 to act ‘agit would - 
for’a Z:score. ‘of anormal curve; and. include .0668 of the population., On: the. 
other hand, if the correlation between. achievement and potential is higher, “say - 
.75, then Oy? = 5, and 94 = Ve* 71. As shown in Figure 12(a}, the result is 
that there is a-cut- -point for the observed difference scoreat 24 Ht Pies 2:14, which 
“makes a. very conservative ‘selection (under the ‘normat cone of .017 of the 
population. In general, then, the number selected for a. difference cut-off will be . 
ae function: of the carrelation between the ‘two. measures. “For: ‘comparison, 


+/ os RIGUREA2 * 2 
HE E RELATION OF. TEST. INTERCORRE 


“ “Test 1 and” Test. 2 have . 
: variance » = 1. 00 


. “cuter eae 2 Ww. 


fa) When r=.75, just 4 T% of: ipdpuletion i is ot 
salacte, wtien cut: point {ies ‘terms: of test) = 1.6, 


: Ab) « When t= = 90. then 14, 5% of fie: povulation i$ 
" selected. using. “the same cor ‘point as ‘tor tah, 


anfamnitiat with auch aanran ) In contrast; the: variance sof  diference scores, a 
1.00,. would be zero. aE . 


_ TABLE . 
RELIABILITY OF A ‘DIFFERENCE scaRE: 


“Coefficient of Ecereiatian = a. 
_ Between. the Two Tests So ae, He of the Two Tests 


ty fog) f2e- 


900 


B3 > 


gq: ad 


es would be higher than the average reliability of the tests. ley 
Except for: chance. “sampling: ‘variations; errors ‘of estimate | “in. He 


neerned, such’ an event ‘cannot occur: therefore’the blank. ‘Next’ to. 


hi bl nk a area is a diagonal of zeroes, for. the case. where the: correlation between | 


easuring: “Test 1: is “the: sar me as" Test. 2. Phius: there. ‘canbe no real’ : 


meaning, except. error of measurement, ‘in any ‘individual’ difference between: the. 


score onc one test VS. une score on the other: therefors the’ zeroes. ek ee 


aoe? 


At is’ evident, then, that the: reliability of the ‘differences: rapidity i increases as the 


eliability. of. the two tests. rises. ViS-8-ViS: the correlation between them. And. the. - 
reliability of. the. difference: would. be. ‘perfect when the” test reliabilities ‘were 
hemnselves Partect, | but the’ Correlation between. tests. was ‘zero. ? 


dust where, ‘in “as able, is 4 ‘wpical situation where we would be selecting. for. oo 
earning disabilities, cand: contralling for. Foie Note that. any. word we: use : : 


for: the . ‘control variable. “potential” or.. - “expectancy.” or: predictor’ 
ae “aptitude” “or. ability”. a sae ‘the’ ay ee there is normally a substantial 
: correlation between that’ contro! variable {10 or: other measure} ‘and the specific © 
“trait or: skill: for which’ we are selecting our LD children. Therefore, we.would » 


wt place our circumstances a) a pened row of the ¢ Stanley table. 


Now: we: consider the diagnostié: Lo tests, and examine 2 a useful summary of their: 
own reliabilities, “seen in: T. ble -2.. “In this Table, we ‘observe: that most of the. 
frequently. used tests. ‘have themselves reliabilities. in the. moderate- range. If these: 
specific tests are correlated with ‘the ability measures, also i in the moderate range, ° 
hen we would expect, Lin the Stanley. table, reliabilities for differences hovering 
in.a very unfortunate area close to. the diagonal ‘of zeroes. The. situation would... 


be. partly. ‘saved, depending on the reliability. of the predictors — = which, as in the | 


ase .of. To) measures, can often ,be quite high. Yet we ‘must face as well the 
p roblems created by part: -whole relationships. To the extent that ‘Verbal 
“Expression, ” for instance, will influence scores ona youngster’s ‘$10 test, we:have. 
founding” of the two, since VE*may be thought | of as part “Of 10; “and tl the 
orrelation between them will be.raised, Creating. further difficulties in. appraising 
he: difference score. (And tht is surely what happens with such a battery as the 
bled Mlinois Test of Psycholinguistic Abilities. +) Beyond: the purely psycho.» 


“metric problems, there- are ‘obviously philosophical questions ‘in these part- whole: 


“relationships: when: we “control for ability,” do we ‘mean the ability. without’ the 
confounding specific disability? Serious. discussions. of this question are not easy: 


o.com oe and solutions are rarer still, 


arenrenernnnrert 


age TABLE 2 is 
TEST- RETEST RELIABIL TIES a 
OF FREQUENTLY. USED: ABILITY MEASURES 


’ Reported 
. Test- Retest 


‘Reliability — 


evelopmental ‘Fest of Visual Perception 
“Eye: ‘Motor Coordination 
Figure Ground 
ot Form Constancy 
“Position in Space 
> Spatial-Retations . ele 
: Bender ‘Visual Motor Gestalt Test 
*, Chicago Test of Visual. Discrimination.” 
Revised Visual RetehtiagyTest 
Memory for Designs Test {Graham Kendall) 
“Primary Visual Motor Test ?° 2 
“Developmental Test of Visual Notor (nama 
sees Test of. Psycholinguistic Abilities ° 
. . Auditory” Receptions’ 
Visual Reception. 
- Auditory Association 
‘Visual Association 
Verbal Expression - 
Manual Expression: - 
*. Grammatic Closure 
"Visual Closure: _ ; 
"Auditory Sequential Memory 
Visual Sequential Memory _ 


From Ysseldyke and Salvia 4 1974). 


Using Frue Scores with Tex Differences 


bei te ¢. othe bottom 2). there'i is no difference ‘between: using true scores — 
or. ‘observed scores; and: that, when cut-points are established j in terms. of observed” 
distributions, the. ‘selection: is simply much: more conservative. for true. scores. 


i For difference scores, te iacommenniacon of using: true s scores. is $ also made, For, 
example, - Ysseldyke 977) ‘states: ‘I believe. we should We” ‘computing | 
liabilities far: differences between estimated true scores -and -using this 
: information in making: identification and placement: decisions” {emphasis in the” 
“ original}. ‘His principal motivation, t believe, is to help the workers in. the field. 
gain.a more careful and conservative attitude ‘toward the’ differences. reported: Tous e 
and” this. “goal I strongly, support. The only: ‘liability - ror this perspective ‘ot 
shaping attitudes, -is: that the -term: true’ itself might \assume> a. completely : 
spurious” mantle of accuracy. The ‘true’ score is, by definition ‘100% accurate, but ~ 
“we. never see. it. The regressed, ‘estimated. true. score; indeed,: is closer-to the ~ 
“probably. true. measure. than is the observed. But, as we. shave seen,-it'is no’ more . > 
“accurate, in rank-ordering ‘the pupils than that: fallible observed score on. whichiit > > 
Las based: tn fact, it rank: -orders them the same way. In terms of professional use we : 
“then, it would be’ helpful: if all the ‘connotations of the word “true” were not 
“carried « ‘along as excess: baggage when. we > talked about these scores. Perhaps. 
“regressedl score’ "would be less met but this. would need some discussion, 
2 and: pomply | tield: tryout, tobe sure. 


. “He wever, ir is a separate question. what effects the estimated: true ‘scores would .° 
have on the tasks of als ‘identification and. ‘placement decisions. For. any : 
“difference | Score, D. =.) Ki . Zor we have the same principles in: operation as for” Ao ay 
“single scores. In’ enor, 13,;we see. the two cases compared tor difference scores. 
~ "We presufne ter phe Figure that we are comparing a Reading Score (Xp bo) with. _ 
<.an. intelligence Jmeasure MX, Qdewith, respective relrabilities. of 0 a 90. We 
examine the fase of a student whose. Reading is -2.00 o and whose IQis -1,00.0. 
“in Case (a), hen, the Difference Score ‘is *1. OO. In Case: {b),.we have regressed: ; 
“each score | fore “computing the difference, with. the result® ‘that the. “true” ; 
Difference Score is now -.5.— just half what we. found before. The.effect. of. the. . 
rue-score transformation’ here is to shrink the difference score (compared with 
that’ computed: ‘for the observed scbres). However, if we give the higher reliability 
to the Xpp. and the lower to the X,,, we find that the “true” difference © 
‘becomes slightly larger than the observed difference, 1, 10. This meee: because Os 
“the reliabilitites “SErve .as: wselatys in the equation. : o. X ‘ 


: FIGURE nn 
“OBSERVED V vs. TRUE DIFFERENCE SCORES 


toh. Difference af vue wore te lev standard fren, 


Dian . ao *ig = ot Shs 


Thus we wae, that. “deviatign®: "scores, computed by such subtraction, are much me conservativ 


“. obServed 2 score for some ‘control, silty measure, and sai is. the: 
‘corresponding true score oe 
: retiabiljty: of the LD measure, -and 
reliability. of ‘the control, ability measure. 


Now we. e know t that 2 
OD. 


Leta us assume, asi in the typical case, that Zz Szchw and re ;>9. vin then. 7 


sansa a a ae: z i a - 
~Q when = - 22 : saath) mee 


2 ’ 


Note: _ These. values are all: ‘based: ‘on: the situation of Figure! 13; with a a Specific: 
‘Score of 2. 00, and a. Control Score. of - 1 00, AW scores are in terms o the Z.. 


“compare. ihe: -difference: with ‘the estimated true difference, 
dict: the. ‘relative. sizes according to functions of these same. ‘ratios. We 
ith the knowledge that ~ m0 


regressed scores, 


. These equalities ‘snd inequalities numbered 4) ‘through. (6). display the 
complexities we encounter, when we: transform, scores to estimated: true. scores, 

andt then attempt to understand better the differences between the potential and. 
“the achievement’ Jn the various deficiency. areas. What keeps coming back to us is. 
hat: regressing the true score, while it gives us a value closer to. the: fong-ran’ 
‘observed for a student, will not: ‘help us rank-order the, students, in order ‘of need 

“or priority, any, better than the observed score, exactly because it is ‘equally 

__ filled with error. And as suggested, the-label “‘true’’ may. serve in the local. agency. - 
‘further t to AOSD a ‘misplaced Sopnence: in the resulting numbers. ° 


Regarding: the use of the ‘reliabilities of ‘the. “true. differences, "these would 

“appear-to~he- the> same™coetficients” as” thse” forthe Obsé arved “differences” since ae 
‘the same. uncertainties enter in each case. -However, the standard error. of 

“measurement of the difference (SEM,, ts) would: apparently’ be different, since: 


the, ‘standard’ deviations of ‘the. regressed. scores would clearly” ‘be different. from. ; 


For” the: ‘observed: indeed, “without: working. it out, fofmally here,’ ‘it ‘seemis : 


that the: ASEM 544). af regularly: reported _and- transformed” into _probabitity - 
‘distributions about the. estimated value, would play the same role. as working 

vith the true. scores, so far as we are concerned with the proper. display ‘of 
incertainty of classification. That is, the local. agency could work with such. 
glassifications “as ane following: “Jobnny: 's Reading seems to. ei -one. Standard, 


x datagrogessing spect at’ the: 
and, | ocal levels. The programs would ‘be easy to. develop,. wi ether ‘under: 
ivate auspices, and could. be made quite: general’ ; 
racteristics of the. component. tests. could: ‘be: ‘entered easily as input; orethey ° 
COL ido. made guite specific to the particular test: comparisons desired. 


All of these complexities add more doubt sau the roles played oe many ms the 
* professionals. serving on: the - CETs atthe local. fevel. How. many will be able.t 

recognize these problems of: classification, and take: “Proper account: of them? : 
How. many © professionals . fat any. level): could) work out: such: ‘individual 
-probabiffties’ at their. desks, even if they had time to do .so?- Yet- “such... 
omplexitiés, “however technical, are important in such cases; and nots “soft’ 7 
that: is,. subject. to. serticing “reinterpretation . of a subjective sort. ~The 
reservations about"‘clinical’’ vs:“'statistical’’ “judgment: are penaoleny rélevant’ 
when, the quantitative a sae are as. complex as these. i 


, : Increasing the Reliabi lities 


; ©. : a. ; 

< ecogalzing: the limitations ‘of current strategies 1s one thing, but improving ‘the 
--teliabilities of the: component tests is Something else, and ‘certain to be atrongly .» 

; “desired. - To -the. extent swe. can: improve such. reliabilities, then the ‘wrue-vs.~ 

observed-score ‘issue becomes. of less importance. —— possible ratio’: of. 


“doing $0.3 ware the following: 


U De: much more. testing. tae tests will combined Rave considerably more. 
reliability {and probably validity.) than’ one alone. To the extent these may. be 
done with less expensive: testing (group testing or self- ‘administered testing), or 
may _ be. respectably ‘performed by: less- ss-trained. ad_professionals, _the cost_may be. 
— “reduced. But in any case, the uncertainties of classification, and the likelihood of 
‘ wasting . large amounts of money through such. uncertainties, argue. ‘for much. 


oe more of the total investment to be spent in ‘Proper selection, diagnosis, and. 


‘potential’ 2° EE. we are. talking about “intelligence, then ibe most. i yeneral. ana 

“really” fundamental, - definition of it is in terms of the. pattern of positive 
: intercofrelations found.ina matrix of mental tests. This is Spearman’ $9, the first. 

principal component ofa battery of mental tests. _ The: development ‘of “1a” tests 


“FIGURE: 414° 


s Pi . : 3 


As THE PUPIL DISCREPANT It iN: TEST ae 


= oP geen eS 


: inet @ of the other tests may be used to increase the sensitivity of. the compa : 
wi th Test B. ; : : 


’ 


. 


“Here we “see » that ‘the profile ot a ‘student, froma patie of mental tests, may. 
“have: some. Variation. tn general, however, g will imply some. similarity of. test. 
“range. Uf our concern is with whether 8 is sufficiently. ‘lower to merit spttiel 
treatment, we may increase the reliability of ‘the: comparison by. using the 
battery asa whole. This may: be. done either: through the loadings: on the known: 
a general: factor, .or perhaps more conveniently through the “total scores” ¥ 
~furnished-by~some-test- ‘publishers:-We- can-observey in-the~Stantay ~ ‘table that ~ 
increasing ‘the reliability of one test t substantially increases the. reliability of the- 


difference score: 


3) ncreasing, ‘the. relevant. items, A decision system Yequires additional attention” 
tO. the zone of. ‘the greatest uncertainty. Miiiman (1974). Suggests constructing an. 
: "uncertainty. band. around: -the passing standard (tor any. selection). Those with 
Scores in the band. would be given more items so that a more precise estimation - 
‘of true: scores may ‘be made. As we ‘have seen, such “uncertainty bands”. might 
be Quite wide. oo bands are: ® also serenes oy warren, Hamble: 


“2h For: -our purposes, ithe 
iN ‘be. approximately normal. 3). For. ‘these 


“and B . plana 60 with, each other. epee observe’ that: 
ices ar not selected: aS. LD. ‘by 8; in fact, only: round one ‘quarter 


ei the case where tae = “80. ~ a very rare. agreement among 9 judges: 
rere is: co large: ‘subjective element. ‘Even $0," ‘most ‘of. A’s"choices are. 
): ~Evén with such, a. high, concordance, 2 
a ‘school: system would “experience | chaos in admin@tering: an. appeals. 

progr m, with the first diagnosis typically overturned by the first appeal. : 
“One “other ‘perspective on “this question is exhibited in Figure 16. Given that 
*udgs’ A. made the:tirst selection. and.the correlation. between.A and Bi is: -60.“the-. 
Figure shows the: small, cross: ‘hatched portion to iflustrate the ‘concordance of 
Selection into a an extreme prewar: swith ah: admitted. is 


An sum, the. system, of appeals appears to pibed ina ) dilate: either the ‘apes! level 


will be’ influenced © by the original jjudgment {in which ‘case it is not. an 


me independent. appraisal), ‘of it will not be so. influenced tin, which case it will ‘quites 
. ‘possibly “not decide the: same way). If the appeal is from. a selection for. LD" 
a treatment, then: athe appeal ievel: will typically overturn the. original placement. fo 


eT typically “Support ‘the original decisce. “And ‘the | difference be between’: these 
aS two cases is, as we. have seen, an arti fact of the ey of judgment. , 


Further Questions about Appeal Wa. 


N , 


There “i is much’ that. is uncertain “about this second judgment. In neneeal: it is well” 


‘ established that clinical judgment-is less certain. than. more mechanicaljudgments as 


“from: objective measures (Hills, 1971). One question, then, is ‘whetherthe appeal 
judge: will, be aware ba the. E fOrmney judgment ‘made. if sO, Athen any bias i in Judge 


FIGURE: 45. 
THE’ SELECTION OF EXTREME’ CASES” 
BY TWO. INDEPENDENT JUDGES » 


: ia) ‘Shaded portion isLOs chosen’ by Judge Aas “bottom 2%." 


eecerdrrrtTT1 
~ Shaded onion is. distribution of A’s choices as scored aby didge 8, 
givenva Poeatae Tag” Or ; ; sa ees 


ic) Shaded portion is distribution of A's. dices as noe by Judge B: 
aap a correlation "aB.” = 80. : 


in th), only one- quarter al ‘AS “choices. are chosen by BL In ic}, only two fifths oF A’s chiviees 
‘gre seconded by a. (See Note tat eng ot chapter. a : 


~— 


Se tiiceediet ae 


er 


- SCORES OF JUDGE A 


Cu Poin t. A 
_ The concordance of two: independent iadyes; with . 60, in selecting * 


an extreme group. Tha: Drobability of A/Bis about: 25, (See note 2 at 
end of “chapter.} : ue “4 


BIGURE 47 co Oe 
‘THE DILEMA OF A SECOND JUDGEMENT 


“JUDGE es | 
OPTIONS: 


“.BIASSHARED | ~~ |. INDEPENDENT]: 
WITHA fs Pe ORAS 


=} CONSIDERS | | CONSIDERS. 
‘{. A'S JUDGMENT, “| EARLY TESTS. 


Either a) Judge, 8 shares bigs. of Judge A chien either (2) | considering A‘ s. 
judgment, or {3} consider fig: the same tests and other materials used by AL 
7 (4) Judge'B acts inde indently of A: “(without knowledge. of A). An: cases 


‘Zand 3,.there is: indeterminate bias. ‘tn case4, concordance of assignment is” 
“bey coe: as enced in text. 


f swe, assume that there are, minded, many. more thet 2% who ! need” acl 
attention, then ‘this ‘difficulty. of. ‘choosing, extreme cases -reliably._ is. not too 
pvere! ‘Wf anyone. in:the’ bottom: ‘two standard deviations 16%). needs ‘help, then. 
is no. ‘particular. damage is ‘done. by. not selecting exactly the bottom 2%. For the a 
~ Purposes of avretion into the progam then, we may: consider the error not es 
“malign. me - : n we a a 
The great disturbance, as. we have seen, comes: with’ the: expectation that appeal * 
will ‘provide a system for redressing wrong. It will. do: such thing, for it is 
caught.in the dilemma: (1) of being guided by: the: previous ‘fallible. ‘decision; an. 
which case. it. will: share. the same biases and. errors off fjudgment or (2) of being 
independent, in. which case it will mean. a nearly systematic ‘overturning of. the 
earlier judgment - placing an enormous. ‘Strain on. the system. In this dilemma, 
: there: ts mo such thing asa “compromise”’: if Judge B gives any attention ‘to. the. a 
- earlier judgment, he/she/they/it. will. be: ‘contaminated to an: undetermined. . 


pane \aacamn-e tn ate uname Witestenestn ain tnstananesane rete twemn ds anand 


This: chapter: has. concentrated on questions of reliability: in “tests, in. a.differenca” 
scores, in agreement of judges, . in the use of appeal: procedures. We have noted | 
some recommendations: about improving reliabilities, but the ‘overall rec om: : 
: mendations for the’ local and state systems are. saved. ‘until ‘the summary" ot 
Chapter IV. Mi, As we see kG - 


x2 2.27. “Thus for Figure. 
taken to: be: 2th. x 8: = f 36. ‘The error in: 


a given: aaiecese or even a ‘given treatment, i 
‘ fair: ‘or. unfair: “but to ‘receive (within the | resources. ‘available). trea 

which: will alleviate the handicap. ~ ‘this: may be considered alcriterion « of Hairness 
to th individual. an OE re : oe 

Yet. often, : to raise ‘the question of ‘sHectiveas, of treatmentseems. to put : a 2 
critic: ‘in the role of the skeleton at the feast. PLL. 94. 142 was obyiously designed. 
under © the ‘impression: that we had. effective diagnostic - and Prescriptive. 
competencies, ‘and treatments.of proved. efficacy. Ysseldyke (1977). forthrightly 
“states there is little -“empirical. evidence to: Support: the con’ tention: 
; nterventions. or treatments lead to desirable. academic” Out omes, “ cand” again: 
“‘taisés: the issue of "the ‘extent to which we. can ‘continue to assign’ students to ot 
instructional: interventions with little if any empirical: support, am the efficacy of 

hose interventions’* (see also ‘Ysseldvke & sabia, aa 


: Clearly, we: need far. more evaluations of programs: for. the handicapped: nd 
hese: must somehow: escape” ‘the: problems of the past. Above. all, evaluations. 
‘shoul d be: conducted by competent, Skeptical, and critical ‘outsiders — ‘not those | 
yho t have much to benefit ‘by the finding of successful results° The Past twenty. 
years: have demonstrated: how: often we may be. ‘confused. by” results. of ad hoc 
S ‘programs, without. standardized evaluation techniques or ‘external. controls: (Page, 
‘19:72a). The” greatest. insights seem to come: when external: agencies survey ” : 
material, Pomestanely across: Substantial data. sets (Colemen et al, 1966; ss Reve. hoe 


fail: wher “~workiig” witha very 
sondarsioey ‘response surface. Yeseldyke- (1977) has correctly. identified 


neoe themes: ‘in-special education: one: concerned with causes of-the disabilities; y on 


the. ther arguing that causes are. quite. beside the. point,. provided the: ‘specifi 
yi ities” can. be corrected. One of. these i as more akin. to. ‘cognitive psychology, 

a othie to behavior mod: ‘One is more akin to traditional science, the. ‘omner “a 
more 9: ‘Prectica engineering. ‘One Can surely arque both’ sides. : 


n 


ati in ‘the long tun, nowaver rien’ we. e need specific and immed e s tarnsdles we-. 


must. + Keep puenng for better understanding of the causes. ~ en een met 7 ¥ 


ne aeons to ‘which heredity: accounts for. ‘measured behavior» - Ree 
: because, “prafessionally. speaking, we are not ‘concerned \ with: heredity at alt. That = 
vif the: total variance. of a trait consists of ee ol a SS ht Oe 


as - educators, v we are. coheernéd with 4. n2ythat variance. e remaining awithin - 
ntrol. of: the ‘environment. The implicgtions of h2:: “then; are interesting » 
regarding w/ what. .we eae to. sesh ads (Cr. Bereiter, 1970. hs 


in ‘general, the: éeidenes ‘of high, ‘broad tert ability of mental ability is. now. $0 
onsensual. ‘that it ‘finds Hts, way Into, standard, elementary” textbooks (e.g. 
Hitgard, Atkinson, & “Atkinson, 1975) without debate. What" is. more. ‘interesting: 
and much: less understood . is the heritability of profile: differences, of specific 
cabilities. , Let‘us consider: the list of cértain prescribed Learning Disabilities. under: 
PL. 94: 142: “oral expression, “isteni “comprehension, written expression, basic a 
reading: skill, reading comprehension” “mathematics~ calculation;-mathematics~ 
reasoning. When’ we tind marked profite differences i in such skills, to. what: ‘should... 
we ‘attribute: ‘them? To genetic differences in the ‘traits? To past environmental e 
histories?: Toverrors: of measurgment?. As we shall ‘see,. the. coniéern: V about. errors. 
of measurement is a. ‘real -one. But’ once reliable profiles. are established,: what: 


“altering | the trait, “(That i is, by! environmental differences ‘such’ as found. in “our 

oo culture, In theory, if.we: e had some. ‘effective “treatment available. le. which ch was A idly = 

“ever. found in our, culture, we might hope to improve. the. trait, regardless of the . 
ent high heritability. ) On the other hand, ‘if-h™ were’ very low. for. the true 
s..then we. call nape for, variqus: yc eauatization” Programs. having a. lands 


: ‘not eanlich attention. has been. given _ the specific ‘corning: 
Disabilities, oar their: heritability. Some related information, however, is 
Neilable to us dois other: work. “The Msual: procedure j in large menting Programs is is : 


ing to zygosity 
; : 0 space® fo 
ne “large ‘data ‘set: was = gurveratad by * the: National: “Merit Scholarsh 
yal yin } Tests of: the early 960's; ‘and: ‘interestingly: analyzed’ ‘by. Uoehlin. 3 a 
icho 976). From, the: intraclass. correlations they: Present... we can estimate 


= English Uae. . 
- Mathematics: oe 

: “Social: Studies 

i Natural Science | 


The: tabled. ‘values: of h2 have not ‘been corrected for’ the unteliabiiity of the. 
‘scores, an alteration that would typically increase ‘the: recorded tieritability.. But. 
these . are onty: indications from’ ‘avery recent “study = As shown elsewhere, “the: 
he tabilities of scholastic achievement have a: fair range of moderate’ coefficients ' 
‘in the literature, A@.9:,. “Jensen, 1973, Ch. 4). in Australia, - investigators. found. : 
“heritabilities tor. a long list ‘of achievement tests for 15-year- olds, and they were « 
‘as. high | as those. for 1Q, largely i in the .70's and 80's (Martin,- 1975, p.. 225): Still, 
one could. argue . that the. hereitability of achievements. is deterrhined by. the. 
Joading: ‘on a “heritable g factor; that the profile differences; in other words, were ~ 
- the ne result of environment, ae : a 


Koy test this heritability of: specific. me Martin, (1975) looked. Yor. telltale 
interactions So ‘covariances ‘for different school achigvements. With “small 


! ~ poe of 1a and height. ip< 01). This study only suggests rat i 
‘for analysis: ‘of such: questions, one points: toa fair Prphealty of Roding specific 


nore ‘basic: “research will not immediately ‘affect local: programs: Spat. vat a 
level, as evidence. i$ 3 gathered Jn, we. should” = able. to. ‘make better 


sometimes. ‘reasoned. that learning disabilities. ‘should: be jiedged difterenpy 
, ¢ ettinic groups. That is to say, mental ‘retardation. would be indicated 
as. {tor example) two. ‘standard deviations below. the group of the subject ‘child. 
nd: LD: conditions would: be diagnosed less often, for members ‘of groups which “25 
vere “an-the average, Jower- in the. skill: ‘concerned. A clear. Statement of: this. : 
won| is from Mercer. (1972): . : 


* 


: celal, ‘in. a pluralistic. assessment, the. meaning ot a particular. test score or. 
adaptive: behavior score should be interpreted nat only withia the tramework 

: oF othe. standardized norms based 09 a sample of. “Anglo. children Toy: this is 

“meant. the white; English-speaking majority): but should also be evaluated ane 
“relation: to the socroculturat ‘qroup.to which the child. belongs... . His position” ae 
can the norms: for his own sociocultural group indicates his probate Parente: 


or learning {p. 445) 


“er us conde briefly $0me aaatneate “about | thie matter in THe case 
OF native: ‘born, Pees spgaking children of- whatever ethnic or ‘national 


ites SO RAPABEEB CS oS 
“AVERAGE 1a: SCORES: BY. RACE 
SAND pas SOCIAL CLASS. 


_. Upper -Lower Difference 


“White - : 1 11.88 : 


| Ditterence 20.25 = 12.18 


i of 4 Data from Shuey ( (1966), 2 520. 


Uilferences: within: the social” lee. and. “@pecially he “fact that, “across ‘th 
hundreds: “of: studies: ‘summarized in: the. _table, the: ‘lower-class: White” ‘group 
exceeded the ‘higher-class: ‘Negro’ group.: This’ is-not’an. “unusul finding; though’ : 
remains. a finding that. is ignored’ in much planning. ‘lt was also ‘found, in quite. 
different samples, by Coleman. et a/.. (1966), Wilson. {1967),. Scarr: Salapatek’ 
41971) and. Page- and, Grandon (1977). ‘In this” last, the large samples ‘from. the. 
; National Logitudinat ‘Study were divided into. three social classes: the top 25%, 


ec middie 50%, _and. bottom. 25%, on the: “basis of five variables of.inceme, ‘parental + 


occupation: and. ‘parental education. Th ame cut-points were ‘usedsfor SES-for * 
all ‘students. Here, as in. the other studies, ‘the top-SES mean for the Negros fell” 
“just below, the .bottom-SGS "mean for the Whites. (This finding was by: ‘product. 
of the. search for explanations of { fathitysize effects, 7 


y This ¢ finding 0 of persisting Black. White differences despite comralling for sqcial 
lassfis a ‘course . the center oY the “nature. “nurture debate,” as: ‘widely® woged in> 


it essentially removes. the” variance | ; 
e,. and: consequently the means May. be: considered: “equal.” ie : 


color-blind MR: or ‘Lb “classification: ‘is s ‘used, there: will continue: to. be. ean 
isproportionate. numbers ‘of Black: youngsters ‘included: and it should. be ‘noted, 
examining the table:above, that: a substantial number of these included Blacks 
m families cwhich. are’. middle- or ‘upper-class, a situation: which 
ndoubtedly © creates: considerable : "and : ‘unusual ° strain in ‘relations with. the . 
‘seiring, walieducated, and affluent: Black parents. 1a S Pe ee 
Therefore,” we. ‘should me what sencladlons are scanty justified by the . 
available: evidence. and: logic. ‘On’ ‘the question: of geneticity, one of the most 
‘recent, “thorough, ‘and objective analyses. is forced to a, still: “uncertain “outcome 
consistant with a> genetic .interpretation . but not necessarily excluding a 
‘subcultural. one!” (Loehlin, Lindzey, &- Spuhler, 1975, p. 238). These authors,.. 
ike. Nichols (1978), outline a nymber . of. ‘promising avenues-of research: into: thes 
question. for the near. future, including the ‘eugenics-dysgenics ‘trends, ‘which’ for . 
‘minorities they. erm. as! “ta her more. urgent” (p. -256) than tor ‘the: society asar 
; whole: Scientifically, then, ‘if we. review carefully the status of. ‘the question . 
~ SaPMONG Most. scientists who: have. studied the issues, we must conclude that there we 
is a clear consensus that genes are’ ‘important. in intelligence, ‘put not a clear - 
- consensus about the possible. ‘genetic contributions to the. widely, Opnerved race 
: ,_ differences | in intelligence and ‘school. Py ase aS 
ot the. jury. is Stilout scientifically, ALAS. also still out iegally. The term “reverse. - , 
_ discrimination” has ‘possibly overtaken the term ‘ “affirmative action” “in the - 
~ Press, in: Stories centering Sround: a “number of court tests. of racially selective : 
programs (e.g., Bakke v. the "University of California). ‘And the question of: 
. whether tests are. fair to Blacks is the Sublet oF other.court trials {e.9:, oo P. #2 
“yo Wilson Riles) oe 


It sis necessary to stress this very incomplete situation, both scientifically and 
——legtlly _-when-we-consider-- the-possible-use-of tests for-the: andicapped.-lf-we- iar 
~ aside: the nature-nurture controversy, and study” only the relationships outside — : 
os the genetic questions, . then the consensus ‘of Scientists really, becomes quite: : 
: “decisive: there 4s not. ‘real , , dias” in current tests, if we take as evidence the; 


“measures in the educational and. ‘vocational ‘world. inveligators quite outside the . 
“genetic debate have concluded that the -races share essentially the same 
regression line. (for the prediction . of other perfomance Gueuny, testing) for 


tri lly, then, iF believe we. ‘must ‘conclude ‘that, for. English-speaking 
Sc whenner Black, Oriental, Jewish, Eastern. n Eyroneeo. or r ofmer, ‘the 


What would be: ‘the practical itect of such a ‘colorblind pales) it would mean : 
hithat. the. classification: of children as the. victims, of. -fociogultural”. irene 2 
would become less frequent. tt would: 


= the composition ‘of b programs: ‘Would “depend ‘on- ‘some “unresolved 
“=squestions: The Federal’ “guidelines define: LO “only ‘aS .@ “isevere discrepancy” 
“between ‘ability and: ‘achievernent, and do: not further’ ‘define “severe. discre- 
pancy.”’ Therefore, the’ LEA must operationally define LD for: itself. tf LO is ™ : 
defined in’ terms of absolute handicap relative. to the population, “then: thes 4 
proportion, of Blacks: would be large. If LD is defined in terms of deficit within — 
“ao individual profile (i.e., achievement after controlling’ for’ ‘potential’’), then. 
A the proportion: ‘of LDs. would probably be not much different whatever the 2s 
ae ethnic ‘group. considered. (This is, another. way of saying. that the variability 
“within profiles. probably’ does not:greatly differ from group to group.) The most. 
: probable. resolution of the guidelines will. probably be.a combination of these es 
two-¢ gnsiderations, a- compromise between these extremes, selecting: ‘those quite 
low in LD category, but within a “normal’’ range in generat ability. To see how . . 
ae a system. "ee LD youngsters, we include ai 18. 


= An-Figure-18-we cofistruct: ~twor populations’ “and"8 to" be loosely analagour us to 
“the: White and. Black: populations. (The letters are used to emphasize that ‘the 
“figures do ‘not: represent data, but theoretical reasoning.) Gratip A has one G> °: 
“higher * "general abWity” than: Group 8; as measured either by 10. tests or by some’. 
9 from. battery: profi les. “According, fo the assumptions here, only those members -. 
- Of each group in the “normal”. range are. eligible for consideration for LD 
> selection. Since the “normal” for Group A has a higher: average. than for Group 


B, we can expect some of this difference to be reflected’ ona specific measure: of , 
* N 


“GROUP A a: 
. > SPECIFIC DISABILITY 
MEASURES FOR NORMAL 


. 


Normal from Grou 


- GROUP B | 
Selected from 8 * 


| ‘ 


ag 

iy 

7 

: 

« 
ae 


Wt only. those wii “normal” general ability are considered for Le classification, the group “with Jower ability. will 


su yield a larger ae of LO classification. 


And alt suoht these aiwine: are not at all’ to a acale. ee inference i is that, in the: 
ost ‘probable resolution ¢ of the: -glassification, problem, if color itself is. no used 
2.will continue to be a disproportionate ¢ number of Black 
ssigned. to. programs. ‘in LD. OF course, ‘if color: ‘7S used as a criterion, then thes 
: psychometric . comments . would. ‘not “apply. Then the. “judgment could be 
“manipulated. ‘so. that, for instance, Blacks” would be only. proportionately 
: epresented:, in any. LD cai gory, or in: the. handicapped program overall. But | it 
“should. ‘be recognized, before implementing such a color-criterion, that the MR>~ : 
sand: LD classifications. will Not mean thesame. thing i in child behavior orin ‘child * 
Yearning for ‘the two races.. Sul more evident will be the remaining differences in? - 
-the* “normal’’ ‘group, which ‘will include. Blacks. and ‘Whites. of quite different 
“psychometric. characteristics. Since Blacks and Whites” share’ pretty much. the * 
5 regression, line, we ‘could. ‘expect ° ‘that . the ‘bottom, achievers among the: 
"normals" would. be disproportionately Black; cespiis their having ability, scores 
“altered | upward ¢ out of Facies considerations. oa a 


Afhg such different ethnic orms, the most. important question may be -: 
«% have not asked, and one commonly. sidestepped in discussion.of the. .. 
‘Law: “Do. we really ‘have skills and prégrams: of proved effectiveness for the... 
"various MR ‘and LD classifications, once the appropriate. pupils are identified? \f 
: ~ not, then such psychometric, niceties as we have been describing becofne less ees 
"> important, If so, then it would appear to be a disservice to the Black children to 
a deny . them the benefits .” ‘of such. -Programs appropriate to — 


i (psych metric) classification. 


The Native eee 
~~-Requirament. and. Assessment. 
‘ . 
ws The. law calls for tests being “nondiseriminatory” to different language groups,» 
and mandates that a ‘test must be given ina child's “natural language.’ "Though 7 
itten in Noirs terms, this phrase-ofthe Law has a widely acknowledge. target: 
0: “Hispanics” That group made up of “Latins,” Puerto Ricans, 
~ Mexican peiacn and other .Spanish- ‘speaking - young people, mostly. from +. 
“Genteal 2 and ‘South America, many, ie them belonging to migrant: ‘families. nor a 


merican: immigrants have, ote course, ‘been off rtanguage background more 


Hepat a themselves or to: the background « culture, has in fact not ‘baer resolved; cae 
and J even. investigation ‘ot it, seems rernarkably ‘scanty. Buti insuring that there | 


the: problems: of: seer see eee “Much, ‘of the. concern, “speaking 
“professionally, has. probably sternmed from. the writings: ‘of Jane. Mercer (1972, 
21977), = ‘it seems sound to consider her principal arguments regarding the - 
Hispanics n. the districts researched i in. California. : Z me : . 


a 


. 4) There’ is the: spepeated evidence. that: "the observed scores 8 of the: Chicanos are y 
well betow thase of the majority eae : 


i -2) ‘as a rae many - more, “Chicanos: are ‘termed “mentally retarded” and are : 
: ee in » special Classes, than is true of the umngiority, children. a ee 


: 3) ‘Mercer believes there’ is an ou of the Chicano children, in n "labeling them. > 
as "MR" on the basis of Englistylanguage t tests. 


ay ‘Mercer tested the hypothesis that the: ‘Chicanos might genetically: have more 

es MRs,. by partiallingmput variables related to “sociocultural factors” on which 
* - “there Was a large difference” berweeri” Chitanos and” triajority ehildren Wher all 
y ‘such factors (including. Spanish-speaking. ‘parents) were partialled out, there was. > 


o important residual .differerice,” between the two groups Ce children, in 


“norms: within the minority group itself, as a way. of avoiding the mmislabeling and . 
. the consequent. assignment to inappropriate educational programs. 


or. prodinags ana assignment; “the sino as. facial labels: “ted -possible 
natives. to > present practice. ao 


orrelation ‘batweatl genotype: and obesived score): “This permits'u us, again, with: 
the: ‘majority. mudent, to predict his genotyne, within ‘the: error Variance implied: 
average. of, scores, eoceny e 


long-ru 


With the Hresetiks student, howe ithe discovered heritability does. ‘not hold, ‘SO: 
farsi as. “English tests are. ‘concerned. Thus. there: is. NO way, from auch a testing, to 
infer: ‘thes student's 


part of 
the same 10: test, or. as alternative: indicants ‘of mental funetion fin World War |, 
the verbal test..was. Army: Alpha: the. non-verbal; ‘largely tor. iMiterates, was Army 
Beta): ‘Seite. Inany: Surednt menses are available 


spore savin a large: deficit. ain -yersal: testing, when: such testing: could be. 
done at all. ‘performed: sinitarty to hearing children‘o on non-verbal tests. s) . 


Fifer, and: Clark (1965): ig a ‘arge sample or New York City: ethnic: groups, as. : 
‘shown, in, Figure 19. Here. “we see the | two- foreign. Janguage minorities, Chinese 
: and. Puerto: Ricans,: to. be decidedly. lower:¢ ‘ons the: English: vanguage 1: Measures, 


Verbal tests. “But though ane variance is definitely, srhatler on the less verbal: ‘tests ; 
et ‘the groups are by ‘no’ means equal | in non-verbal performance. ‘And. evidence from 
“other sources (Coleman et:a/, 1966; —Loehiin.et-a/., 1978, p. 183; Jensen, sori 
‘ shows similar group differences on both Kinds of tests. 

Sous fy, then, if our deal is to be tai’ when dicaeing genotype: for a “broad: 
* cy gory of” ‘intelligence, " we may.not ‘reasonably simply generate new. norms, 
tor: each ethriic minority and consider we have eliminated . the problem. tt does. 
J appear, howeVer, that.there is some ‘detinite English bias: against: Hispanics in’. 
~~ assessing individual genotype for 1g, One suggested” remedy might be to ely. 
“more on the NV: tests for such appraisal. So far, ‘evidence, seems to. suggest “that, 
the problem is not eliminated for Hispanics by simply administering the tests.ins 
. Spanish, ‘with ‘Spanish- speaking rest persennel. {tn Hartford, Connecticut, these” 
“bilingual youngsters, mostly Puerto Ricans. did poorly on both English: and. . : 
Spanish ver sigs of IQ t tests: - cae 6, 


7 ‘ % 


: : One ‘stfateoy.+ “sometimes recommended oo establishing: fair: scores, isgro- make ; 
“some. adjustment for the SES ‘of youngsters. In. practice, given fairly : reliable»: 
an reports on income, .parantal occupation, and parental. education, it would not be... 
‘Hatd:.to “estimate SES. ‘for. each: ‘pupil: and> “to: cmake- ‘some adjustment. for: the 
known correlation. between SES.and 10. The geometric interpretation.of such an- 
adjustment is-as. shown. in Figure 20. In‘ this figure, pupils a,b,c, and would be. 
- reported A “terms of their deviations above. or below the regression’ line ‘of 1Qon. 


egal, oiey 
ys 
i 
? 


2. oe "FIGURE 20. eee 
~ ADJUSTING 10 MEASURES: FOR SES DIFEERENCES 


‘i 7 


‘regression of 10° 
“on SES : 


4, 


gs 
Ds: 
S. i. 

o° 


SESin Z-scores : 

Ine each case, the 1Q of pupils a, b, ¢_.and.d would be reported 
cin ‘Yerms of the deviation from the regression line, Pupil a, for 
example, would be reported as having asuperior 10 wher 30 

adjusted. (This is not recommended for reasons intext 


be” ‘regarded: s" superior’ when 30 ‘adjusted; and. Pupil’ c's deficit: ‘is: ‘even n more: 
adjustment. When described ‘ingstandard. srakaes the: e- adjusted 1a 


Would “such : adjustment “be hee ‘when our “concern, is to express ‘genotype? 
t us. consider 1e question. of, such. adjustment’ for ‘majority. {English- 
itdren. ‘Heritability. is. well-established for such majority iy 


Hilger, ieee Be ‘Atkinson; 1975, ‘especially. pp. 416-423). ‘Also, there is: sof” 
course 2 wall-established relationship. between parent 1Q and ‘parent oggupation.. : 
The <combintion. of these two. widely. acknowledged facts leads: mos’ : ‘gientists 
to. ‘the conclusion ‘that ower SES children” will ‘have,-on: the “average, ‘lower: iQ 

» genotypes within: the majority population . (Herrnstein, 1973). As: we have : 
already seen, suth partialling: out-of the variance for SES, phen, 1 throws out, more 
“than. just ‘environmental, sadvantage; it also” improperly ~ removes vafiance 
attributable to genoty 4 ~ that which we ‘wished to. measure.. BS 


“When. ‘we , consider. ‘the o lecguage-disadvantaged.g groups “such as. ispanics and: a 


“Chinese, the- situation: ist ‘not much better. The Chinese” have done. very: weil. 

-educationally: and culturally in the U. S., and the SES adjustment-does not. seem. 

“ necessary. As for the Hispanics, here adjustment for: SES will not remove the . 
scentral: language . problem, which is that in- their homes English is seldom . ‘the’ 
‘only: ‘language: in’ only | 19. 7% “according” to “Jensen; 1971). The reporting of °° 

: ~ “non-verbal: scores (clearly. labeled as non- verbal) might..be’ an: appropriate step - 

“when the genotyp is sought: after: ‘but it should be noted ‘that: the Hispanics will 

“continue. to trail. ind. the majority ‘spudents {though for NV. ahead of the. . 

“ Negroes). But not necessarily: far behind: Jensen ( 1974) found the Mexicans in a 
Berkeley to be mid- -way. ‘on the Raven’ $ test. between the Whites and Negroes, ae 
‘despite. ‘having a “Home, Index” (SES) as far below. the é Negroes. ‘as the Negroes 
were below the Whites. This ° suggests ‘not much SES drag for the ‘Mexican - 
* sample, but does not resolve . the question. of the “fairness!” of inferring the. aoa 


. “genotype. Ree ne 


St ee ate 


tt is 5 the tentative conclusion here; then, that. other-language minorities ‘may be 
“ reasonably described genotypically by use of the non:verbal ‘tests, pending 
further advancement in either meory or gh analysis: 8 


ot have gone to: sud tength bout te question of genotype of such youngsters ee 
. for two major reasons: First, much. of the writing attacking minority 1Q testing ae 
7 enters aun the question of V“labeting” of the children as mentahy: retarded, eo 


ne more. 2 successful minorities “of | Oren Jewish, or: ottier ‘oups). And i in the: 
ae ‘often used to someck such labeling, ‘the ‘question: ‘Seems to: be. whether, 


he anne cases ‘Ce: Q.: ea P. v. 1 Riles: ‘Bakke ve University of California) « over r the” 
ISO F tests. ane the validity, . of ‘affirmative action. But. apart from ‘these Mee 


he: test and their use; “as. partly being described in: n ther next section: 


Diagndfing and Diegang. Koren dananee Children. ve S : ea 
For purposes: ‘of individual guidance, there is siobebi ‘on arely 2 any need to. 
‘diagnose. genotype. Therefore the. term "10,0 loaded as. it is with (often ‘quite 
legitimate) ; ‘implications. of genotype. ‘estimation,. is. unnecessarily. ‘cumbersome ° 


: and;. when" ‘based on English. tests for bilingual. students, apparently: biased, as ety 


wall. Tiere: are: two cases 5 which’ are at. issue here: 


= Cave 1, is: Swhelher the orate! janquge youngster ig ‘belleved: to be! “culturally 
‘disadvantaged””’ because. ‘of this. parental’ language, An. @ Way, a disadvantage may e. 
be; ‘assumed and defined in terms, of the. percentage: of time English i is used i in the 
‘home. ‘Here it might: well’ be that the status” should be in terms of reading * 
‘comprehension against the non- verbal ‘tests of mental: ability (whether, called. 1a, 
reasoning, “Raven’s,"or some other’ term would te. as. we have. seen, in part a ‘ 
camattel of finding inoffensive. usage). When: ‘the pupil is. no longer much below. his . 
expected: ‘score in English. reading ‘comprehension, he may be incorporated i into. 
the ordinary programs throughout his school days. 
2) Case 2 concerns: ; whether the foreign-language child, ‘no longer classified: as" 
‘culturally disadvantaged,” is in fact a victim of “learning diabil: ity” in one of: 
“the identified LD ateas: In this second casé, the proper. comparison would seem - 
“to be not with his: ‘genotypic ' ‘mental ie (by whatever name), ‘but with his > 
“general, aot ‘werbat ability: oa ah es 


. Thaw iio cases have been’ summarized in Figure 21, hich is a ‘suggested. 
“sequence” ‘of diagnosis tor chitdren “OF, foreigni= lariguage™ background! The sequence ~~ 
“consists of as many. as three ‘testing points, and three resulting action blocks. din’ a 
“the usual’ manner of flow-charts. the ‘decision points are- ‘represented. by = > 


diamonds, with. alternative results; and the volt are shown by ‘rectangles. in. : ie . 


Decision ‘3; jwe note, there:i is testing of 1Q (agai, by whatever: name). of both'the . 
Verbal and. Nonverbal - sort. Here, for purpo! s. of decisions, ‘it is quite 
“appropriate that the’ ‘Verbal testing be conducted. i English (rather than in the © 
. child’ s par, language De since the assignment co templated is- for. work i in: 


: FIGURE 20 
SEQUENCE FOR FOREIGN. LANGUAGE STUDENTS 


Child’s | 
~ English? ~ 
Normal? 


. Treat ihe yo one Treat ike 
ign langage: Ts otmersof i majority , ; 
"and testLo "SES How ability : |". children’s.) 


‘Ar erephasis’on mnainsteaming is here combined with separating fanguage from other problems, 


al-ct id wi be comp pane with rate ‘monolingual peers: “trom the. 
1a, rity culture 2 (Kahn, ‘Note’ Be in” any case, “this: haure is ‘presented, for 


‘often: quite, short: lived: The. term" ‘moron” tee example, i is. now: ‘seldom used; 
and." ‘mentally: ‘retarded’. “seemed. a. relatively . fresh and. innocuous term. But 
‘ rms'dese ibing: Jow-status positions: rapidly acquire: the. Tow: Status’ themsel 
‘adolescent humor: about: ‘morons’: “has” “given: “way: ‘to ‘adolescent’ humor: ‘about | 
ards, At. is understandable that: “sociologists: ‘might: wish: to: break: out-of sti =“ 
pattern, . bu cs linguistic: psychologists . ‘should. Not -be.too- optimistic. Iti 


predictable that, inthe: fairly near: future: if. not: ‘already, “learning disability” sad ay 


"LD" will, be: terms of mild ‘contempt,. if.not.immediately of derision. And 
picking. “completely cneutral’” labels, ° “such: as a as or bay, . “oluebirds” or. 
redbirds’’, will: not escape. a certain heartlessness of. the. young, nor. the anxieties : 
of ‘the Parents, as experience ‘in any tracked school Prem will V ordianelly 
‘demonstrate: ‘See a cs a 
Nor. it ‘should. te. added, wii “mainstreaming” avoid: the labelling process. of. . 
heir peers, and the communities. ‘Relative comprehension will be exhibited. The 


extra attentions of the teacher will be noticed, and countiess events will reinforce - 


‘the impression. of lower ability, and ‘the test score, whether known or unknown, 7 
will: probably. play a relatively minor role in ‘the way: the child is regarded. 


iagnostic instru. 


epend on ‘judgment. And we. have considered: as: welt. the problem: of 
vt (or, the: lack: of. Pin. ameng. judges, vin. the -Feliability of, placement 


‘theory ‘we. ‘can abstract. One. line: ‘of investigation which : seems i worthy of survey 
Js that: which. has been carried. ‘out: in ‘jurisprudence, and which. deals: withthe en 

“actions. of juries.in ivi r criminal. trials.” This brief- ‘Section . could. fittintosa 
“number. of. earlier. Sections. of. ‘this. report, but is unusual, enough to. ‘be Placed. by. 
tse here. at. ‘the end of. Chenter NE, 


AS we. Neve seen, ‘ “the. law “requires the formation oF. Gana evaluation teams , 
PETS) ‘to. make... decisions ° for: ‘the: inejvidual student. Such teams, vat: least’ 
“whenever possible, be “expected to consist of certain personnel: the pupil's. é 
. classroom teacher, a specialist in the: LD. area considered, : ‘and someone — 
competent. in the: measurement field, as well: as ober; persons. When. we.analyze 
t, we realize. that such a team. will, then, -act ina way analogous to that of: ; 
Sjury: While . there is of course’ no. “guilt”. to .be decided, the team. willbe 
- estimating whether a pupil: Johnny falls into the zone of the: “disabled’® and‘thus: | 
“qualifies. fot. such. Classification, or whether. he does not. While “ ‘guilt’: is often. _— 
seen. as. a categorical: variable, logically” true or false,. psychological placement 45. 
~ usually: seen: as eae a ‘cut point fona continuous CS puben: Yet a bri 


omay’ “hipge: around. the hiestes of guilt: and psychological placement does, aher = 
‘all; become. reduced ‘to a yes-no decision. Thus it may be instructive to turn °° 
riety tO" afairty substantial” Nteraturenatiout decision: eran ina jury. 


~The ideal aati ie study of jury trials do not exist; .as abted by Gelfand and’ . 
A eoloaeh: (1977). Such data would consist of. independent replications. of. Arials : 
under’ varying ‘arrangements: ‘of jury sizes and com sition’ ‘and other arrange: 
ments. “As: it is, they: quote: Nagel and. Neef (1975) their. statement that jury — 
-decision- ‘making is “a cross. between flipping twelve . independent unbalanced Pe 
pins and poraing 3 over twelve interacting, bowling ney * The > “inde endent. > 


Fie et ae TABLES Sa 
PAY agreme OF JUDGE:AND JURY DISAGREEMENT 


x 
5 Jury» Ake ee 
“Acquis Convicts. Hangs. 


 Aequits . “434° ers 
Convicts 189: 62.0 | 


‘ From Katver’ & Zeise! (1966, 0.57), quotedin Gelfanet & Soloman.(1977, p. 297) : 


“ae 


. in. ee hypothetical ‘Verdicts, “the judge igs seen to > be somewhat’ more ‘inclined: to” 
convict than is the jury, even whety one counts hung juries as being included with 
convictions, Of course, it would: be: Haproner to conclude, from the Table, that 
erther. judges or juries were “wrong’’ in the one- fifth of trials where they do not” 
agree. “There . are good historical and. philosophical reasons - for both kinds of. 
adjudication, qust as. there are obvious professionalwan political. reasons. for > 
appointing the Pupil Evaluation Teams. And in both cases™he “truth” ofthe 

decision” (whether the accused really 15 “guilty.” ; whether the pupil really is'a 

, vietion at statutory “handicap” }.i5 not. known. Rather, — ing gthe Table © 


> tHavs.: 1973,. Pp. 743), we find an iow of the judges and juries moh, 491. 
‘This way of. considering 3a group decision, then, oy | a regarded as S external, 


regarded, also, as s having some “validity. 


bee! 


Another way of regarding the ‘process of the vey (or team) is internal, with: 


e. > TABLE 7 as 
- GUILTY: vores. ON FIRST. BALLOT. "AND. 
ms ~ JURY ‘DECISION. 
“ANS = 226 JURIES) 


ina verdict 


Not guilty | 
: Guilty. ; 
“Hung. 


“Allvof: the: ‘data: trom Table T were! “collected. trom: 12eme ber | juries, and: are. 
pretty ‘strong: in ‘support, of: the persuasiveness: of the majority’ Where: a. minority 
entered the. jury room: ‘believing’ thé atcused guilty, only 2%. ‘of the juries. shifted. - 

“to a. final decision of guilty; whereas, ‘when’ a ‘majority of ‘any size first believed: 
“the. accused. guilty., 86%. of. the trials were. so concluded. On a. three-person team, 
~ then, we omight™ “suppose that two of - the i members may have considerable 
influence over. the ‘third lalthough, as noted, the; ‘members of PETs each: have © 
: _ their own n presumed special perspective to bring to the. question of. placement). 
> etorn the sorts of: evidence presented in the above tables, Gelfand and Seloman = 
st (1975, 1977) have: designed a ‘probabilitic modei of some sophistication jin order. 

“to analyze. different sizes of: Juries. They. wert responding toa “claim” by the - 
_ Supreme Gourt that a ‘six-person jury. may. be. expected to perform: equivalently. 
‘They corictude, to the contrary, that. in -both the areas at representativeness, ‘of: 

_.juty.compasition andLincthe. “quali. tof decision.making..the larger: jury..will: be 
: more, Affective (977, p. 311). ; oe . 
“tt is. not. suggested here that, for purpases of. pupil assignment, any teams: ‘be - ; 
considered. as. Jarge as: twelve, or even Sik. But. repeatedly, we have. pojnted out 

if that much more “needs - to be” ‘understood about the apparatus, called. upon | to ae 
- make these. decisions, charged as they are with ‘such cumbersome and legalistic. 
and prograne seaponsinilitiss, 2 and depencing's as they n must on evidence ‘which’ is . 


208 as: 


‘In “many areas ‘of gaverntoent’ today, there is a. fandlareente’ coatiiee between: 
freedom of . -information; on. the one> hand, and the. need. for secrecy, on the... - 
At a. Sense, mental testing depends: ¢ on warprise: Tests are lene to. ne 


. te at. tthe. domain: “Um pete Enatween sample and. demain leads to 
isunderstanding of behavio odification, “as well. , 


“Even belo e. L. 94. 142, with its insistence on “public accessibility’ to ratoile ory 
. cand information a and “parent involvement in ‘plan development,” there..was. 9 
“trou e: with - the. security. of some standard: tests, especially: those administered: 
diy dually: ‘for general ‘mental ability. At times, items from the WISC have’ 
. appeared in psychology textbooks (there read by: average college students inthis ~ % 
Most : ‘popular major field). At times, items. ‘trom: WISC or other instruments have. 
peared. ‘in. AP: or. ee “or: vother,” widely-distributed “wire” “services, The 


el iit, | in’ “the: BS. Report "The 10: Myth, on The BS Myth”! ‘wou id have ; 
‘beer!'a'somewhat more accurate title: ) What the effect of this sort of feedback” is, 
‘especially. among collage- educated, “middle-class families, remains. very obscure; 
‘but “it must ‘be cabin : : ; 
“Now, the. new, Law,’ “with its: requirements for parent. involvements _publie ee 
ccessibility, ‘provedural safeguard guarantees,” and. several! ‘levels of ‘appeal, 
2 makes probable a still greater difficulty’ in maintaining the item secufity of such 
“instruments. In private communication, | have learned of remarkable abuses of — 
~ security: at the ‘local level: One teacher. told me “that, "when some pupils arrived: = . 
“for their. testing for. assignment to first’ grade, -they’ may already have performed ms 
perhaps. 60 “draw. “man” exercises! With. attendant instructio and feedback; — 
“such practice would -wholly invalidate: the norms for a pupil;syet such change’ = 
-woutd” not imply. any Shift: in school ability: A second teacher to!d mea similar 
‘story: Groups of up-to 30 parents would gatheP%o go:over the spacitic items tor 
“ sw -the-WISC: ‘or-similar-test Again;-pupils-would: expectably-show-a- -Pnarked-jump- in: 
= overall score, by. being. -pyacticed on the sample used, without any comparable 
: change: un the domain: of knowledge Or- intelligence. How ‘widespread _ are such 
“practices is not “known, but the. provisions of the. Law, and ‘the important . 
“depending on: soe testing, make: sate) more probable. parent anxieties.» 


“Parallel with College Admissions oe 


But sotial igdaen depending on testing are not new; and ie thieate to: security. ee 
of tests. from public anxiety: have .been’ faced: before — most notably inthe . 
all-established field of collegejadmissions testing. Both the Scholastic ‘Aptitude 7 
ests. (SAT) ‘and the. American ‘College. Testing: ‘Prograrn (ACT) have designed: 
very successful systems. far. admitting high-school. ‘seniors to. ‘colleges of mutual. 
‘choice. “And: ‘other. “pk rams successfully test applicants: for ‘admission to: very. 
‘selective. high-anxietys radu te. “studies such. “as. Jaw school (LSAT), ‘medical 
‘s chool “(MCAT), and doe ‘programs. (GRE), A nearly astonishing: feature of.« 
ograms. is’ the absence of- “major. scandal. in olving release: of: test.forms. 
operation = astonishing, in: vie f. ‘the ‘great aspirations which’ parti 
depend on high marks. It may be very instructive, then, to. see, just. how: ‘the: 
group, tests; involving millions of testees every year, are. managed and guarded.” 


3 Detailed crbondures for ‘such ‘admissions ‘testing are’ too" a lengthy to: review: here,” 
but. ‘the: outlines. will. ‘be adequate. for our purp@se. Basically, these “tests ‘are 
founded on’ the: idea of a. sample: ‘of items frorna specified domain. The tests are 

» given: only at “specific times of. the year, administered by outsiders who. are paid." 

«bys ithe. testing: ‘companies, and: each administration” is | ‘surrounded by: ‘many. 
safeguards: For’ example,’ the tests ‘are to. ‘betkept ins sted Ween until the 
actual test time. And’ once’a. test ‘has: been” administered, ig 
longer useful just that form; most of its items wilt not: ‘appear sain a mG 
To. support euch’, a “system, “the: test t industry must constantly: be in: process: Sot 

~ generating | new iterns..for the same target dorhain: ‘gf. abilities and knowledge. 

; teem: writers. are: always busy. “And to Reep | th tandards constan 

: “meaning” "of the: ‘scaled, scores. “(typically - 500: mean,» 100. standard deviatio 
a the industry has developed a very useful arrangement: in each testing period, 
.. ‘there are some items “seeded” among the test items: which will not, in, fact, ‘have,. 

; “any bearing on the applicant’ s ‘score’. These items-are being tested outin. a serious. 
test situation: for internal defects and. for. correlation with, the: already- tested 
items which’ are’ serving .as’ the criterion of a student’ s ‘score. Some of these ~ 
seeded: items: will be abandoned, “others rewritten, others used i ina later, serious” 
administration of the selection test. a 


2 CAN_We ‘us et the eseexamples to improve our testing of the handicapped?. Abelievec. 
“that, at the. very least, it is a matter worth considerable study. Aftey all, despite 
; ; traditions of individuat tests, such as $s the WISC, Stanford- Binet, ang others, . 


“hatter, there As nothing: sacred either -about ‘te: dyoed of: items 
athe current, tests. Not only: are } there mony. alternative: poasibiligtes.. 


MS sat 
tests through: the: loss Fof security;;by iaokiag: closely a at ‘the successtul, practices : 


of college: testing, . and. adapting these to the special needs, of testing :for. the 
"handicapped. re : ye io. ai 


CHAPTER 1 Iv: RECOMMENDATIONS FOR: 
IMPLEMENTATION OF we LAW 


, mc this chapter are grouped the ' recommendations” which seem to foliow from - 

: “the. analysis of. the. preceding _chapters, {tis reasonable to ‘cluster these. , 

_ separately: Itmakes thern easier for the practitioner: to react and toxteterence: 
“Bu trvalsor it 3 ptiasizes the: Ore “tenuous | ity y ort “recommendations, 
= compared with the analysis itself The statements in the analysis are set out with. 
~ some confidence: they: seem to this reviewer. demonstrably “true: on "Actions, 
however; as we, observed An. Chanter. 1, depend: on-the balancing ‘of many variables - 
in “an. ‘implicit’ decision: analysis. Some’ of these variables. include the ‘subjective. 
“values! attached. to outcome; the differential: weighting of various expected — 

i sults, Ini is ic Boosie for this, reviewer. (or, any other outsider) to declare these 


meant by i term, and then, by weighting | 


s the total opus 


3 achievernent oF, aility (mean of zero; ‘sanded hes iia 
of DSS 


ae final appraisal. They, should be: pees into, this - 


. : judge’ evaluating ‘a stuglent did 's0. ndependently, and recorded this, before .. 

"sharing: the. rating with: others. There. 4S ‘then plenty: of opportunity to ‘share. - 
different perspectives in. ‘the evaluation. team. This recommendation stems. from. 
the - “need to develop understanding - of the: team: ‘process, “and skill init, 
Furthermore, “these original ratings: should: -be - retained in: the data systema. . 

(possibly: -after removing identification) so” that those ‘LEA officials responsible" z 

i for; -implementation might learn to nes and such- ‘systems, ae ‘do applied 
research’ on them, - i 


_. aA 


a PMaking decisions about plocement:: What’ is described above’ ‘is largely the: . 
process: of. ‘measurement. Beyond measurement is the necessary decisian about - 
placement. ideally, this decision, too, should. be ‘made’ mathematically, ‘through a- 

weighted: -sum—procedure.Ordinaily,— in-practice- wthere-will- -be-seome- capacity ~ 

: within. ‘the. system, and the decisions about ' ‘severity’ “will mirror: this awareness - 
of resource limitation. (he is. unrealistic: to assume . that there iS. any Cute oft 
dependent. of such resources. } Thus, for most. LD situations, it will be’ a matter 
ank: dering..the: candidates for. placement. as. well: as one can; in, ight ot. all. 

the. vari ables ‘educational; psychometric, judgmental, familial, political) which | 
may be estimated; ‘and then. selecting the most: extreme students up to ‘the: 
capacity. What | 45 urged. is that the. LEA, , together with any y hetp'at the State and 


the. SEAs. The. determination of deliral: variables and their: 
e forms. should ‘be. ae er centralized ; agencies, in close 


samples. of such students. Again; aitcis: “recommended that er 7% of the t otal 
“Cost of. the LEA Handicapped Program be. ‘used for: such a ‘system, “(Note: ‘these, 
7%: recommendations are hot intended toy ‘include’ ordinary case fecords ahd 
— Sens “rather ele are “intended” tor the: “additional, ¢ control 7 


0% in: 1 the next few. years; it AS ‘only cost-effective, therefore, to anaes a major. 
“allocation of resources: to monitoring the early spbroxinations: y. 


4 is a 


’ e-of ‘ethnic and: cultural ‘bias, at is- ‘mandatory ’t that athnic- and pane 
ral aaa ‘collected: for. appraising. any. such bias:. ~Attached. 0. ‘each oo3 
then, will (be standardized information about nic. 
re parental. education and occupation, and > 
the. standard: SES variables). “Again, eet 


13... Collecting sibling. information. Questions of “pias” for the PEP inescapably . 
nvolve: ‘family: Variables,: “since ‘the family,” one : way” “and: another, > typical 
accounts. for much* more. of. the vatiation In ability. and. school. achievement 

“any, within the: control: of. the external society. ‘For purposes of understandin 
‘the sources ofthe’ handicap, then, and the students’ responsiveness: to treatmen 
“ite is. very important. to. take advantage of. the Presence of’ siblings, especially, -of 
twins. Within | “each hundred’ children ina school” system, ata. given iage- ‘level, 
‘there will be at least one pair of twins, who. have: ‘shared’ almost. from conception 

7 othe. same -general environment, ‘and.to a varying ‘degree the same’ inherited. 
constitution. These twins are easily: identified-in school records ‘through: havin 
‘the: same “family names, the. same address, ‘arid the’ same birth-date if we are t 


recommended, rue. that the ‘standard. forms designed! for record: ‘keeping of 
“the | “Handicapped routinely raise the question about: ‘the existence: ofa twin. 
; When: located, test information should be: éoltected on.the twin as well, cand a.” 
“simple form used.to ‘estimate kinship (whether. identical Or fraternal). If the a 
‘is’. also. being: evaluated” for handicap,’.then.‘a flag should be put~in tf 
* standardized records,. ‘typing the two records together, for: ‘research purposés, . 
the: twin isnot being sO evaluated, shen the standard test information, ‘ordinarily. 
: collected, by: ‘the school system. should: be ‘simply incorporated into. the cultural 
x background of: the handicapped twin, Such: twin information: ma prove, ‘for. that’ . 
sample. of. students on whom it vis. collected, to be: ‘the: ‘righést: source of * 
understanding for the later: adjustment 0 of the’ total een. ¥ 7 ye - 
14, Adjusting. assessment | for Negro students: ins ‘most researches, White: cand 
Black” students share. the: same’ ‘regression’: lines’ when. academic attainment ‘ts 
compared.to. general. cognitive: testing. —Thereforeit~is~ ~‘not~tecommended~tnat~ 
a norms be used for Biack studen 3. ‘to the contrary, aun speci ae porms — 


youngster is in fact a higher "seMfever than’ hist tests would sedlicate: there would N 
be-adjustment™ to this-fact {as there would be for a White youngster, a : 


P po ion ot Lds who a are Black, aor statistical, reasons outlined. 


‘general, “rather than. use “the clearly. inaporopriate See. 10. tests to ieee 
general ability, E would recommend using pe Non- -verbal, ability 


classes ot slower student ‘burn ‘not nest the same riuimber: ‘as would be $ $0 ¢ placed Se 
with’ English. (or Spanish) verbal: rests. dt is, not tecommended: that: separate 
norms. be established: for the: Spanish: ‘spagking: groups, and then. 1Qs° artificially i 


“inflated toua normal distribution, without: any. matching of these, spurious: <0 


“abilities” with correspon ling achie ementi.. “Such pratistical manipulation: “will 
only: ead: to’ confusion. and false : -expectation ‘on: “the..part thof'teachers, "parents, 
and. the” students themselves. However. inemost Cases the question. of IQ) is not i 
central. A more urgent concern: isthe. speedy training. in. English’ } 
language” required to ‘mainstrearn.. ‘Latin: youngsters into the regular 

; angen. will. be soaked in. the: mony language and. culture. es 


ersonnel ‘ehpule udaistand that they te “ethically required to protect t dest 
a _ Security: of measures in. use for: assessment Sunder the Handicapped. Law. Parents, 


‘A, ~are weicome to know: the types OER ests used, out nage “necessarily the particular. 
tests, and most “sur Vv not the ® specific items. employed in the ast ‘or to bes usec 
in the. future 


aq 


Thesé-a are ‘only some » of the. principal recommendations which seen: to follow 


from. the arses te chnical analysis, of. ‘selected features of. the Handicapped aoe 
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Bory 


"INTRODUCTION. 


The. 2. aay panel. meeting. provided an appeRLoIG: to brit. together a ‘stil ‘but: ee 
cues o move | cage outers to react. to both the Study; and: “the piciecion in ; 


allowing) jnitial Oe & 
presentations ‘by Dr. oes and Dr. Mary Kennedy, nich. ‘set the general 
ontext for the Study, ; authors presented . surnmaries of their - papers ‘ang. 


3 = -general session : tollowed: to share the results of t ‘he small : 
oo An issue-by: ‘issu “summary of the- panet discussion. and a - 
: summary of “the small ‘group recommendations are” presented ine the > next 
ae sections. . : 


THE ISSUES. 


: “Panelists did not view assessment as a ‘single procedure forming one step of the — 
“special ‘education. decision. -making process. Instead. child a assessmant information. ; 
was viewéd-as critical to ‘the: making of each decision inthe process. Thus, thes >. 
need.for. ‘protection: in evaluation procedures throughout the “special education, ; 
decisi on-making process. was evident to panelists, The central theme of the panel 
_s became the implementation of protection Yin evaluation procedures to prevents. © 
‘> abuse in decision-making, Panelists - identified foug* major questions to be cae 
addressed ‘in the decision-making process, ‘each of which should be based son 
child assesgmnent information. Panelists discussed needed protection in. evaluation . 7 
“ procedures - “related tothe assessment undertaken to dbtain. information’ tO 
respond to each question. The relationship between the decisions and protection. 
; in svalvajiongetivitte ‘identified by the pamel are shown as follows: : 


Decision ‘Requiring Sees ; Protection in Evaluation 
|. Assessment Information. — Procedures 


si nel SNOUICL .thechild. be. refecred:..‘a..-.Conduct-routine screening: [i eee 
fara psychoeducational evas ’ children, 
lation? b. Analyze teacher referral 

. : _ > patterns, 3 F4 7 
Analyze: ‘Pgevious educational _ 
‘ Ss ee - interventions attempted ff 
2, ts the child eligible to receive : . . “Examine the adequacy of the- 
re ‘special education and. related 5 : : ‘evaluation-undertaken t 
services? determine eligibility 


Decision requir ig. Protection ir in Evaluation 


‘Determine t the. adequacy. of the 
gvaluation, undertaken to. make 


oselt study guides for address of the protection. in evaluation procedures | issues. 


i 


Problems i in Implementation - 


Gantral to. the. discuision ot ce 6a. 442: protection. ‘jn evaluati n: procedures 
(PEP): was the issue. ‘of implementation at the ‘local’ school district: Jevel.: The. 
regulation requiring that tests:be validated. ‘tor. the specific purpose. “fo rswhich 
they are used : as thought by. Panelists to be particularly problematic. As stated” 
. by onet panelist: a conduct workshops with school psychologi tt and 1 can ask 
cS how: ‘many of you use standardized tests? And all hands gou up. Then’ s ask on: 
. what-groups were: those. tests standardized, and ‘no hands: go up. People have not. : 
“looked at the test standardization and. they have-not thought Carefully about the» 
extent to which the individual: they. assess” has:a cultural: background comparable 
to. those onwhom: the Jests were standardized.””. A _telated: problem * “was” 
» inappropriate modification of tests for handicapped individuals. One example of 
this” practice. ‘would be, sthe administration of an: cintelligencé test, ‘standardized an 
a) “hearing. population, to a deaf child through manual, sign language. Another area’ 
of concern expressed by Panelists -was the use of - assessrnent; devices, with : 
‘ __feliability coefficients as’ fow as JZ _in the making . of af decisions — wich 
ignificantiy “elfect ‘the ‘lives of | children. “Yet another problem identified was. use: . 

f mieigance test Subiest: scores to make ete educational prescriptions,~ 


f. 


; the: referral Prose: 


= and judgements ze: 


- Those. ‘panelists ‘concerned with ages increases ‘in. ‘the | ndinbers of ‘children 
» referred. for evaluation associated much ‘of the ‘difficulty. with tack of: ‘tolerance 
“for. deviant. -behavior. in: the: regular. classroom: A general ‘tfecommiendation: of. - 
these. parielists. ‘was for-some. kind of validity check on referrals. As Stated by one. 
-panglist:” TAs lot cof: cassessments: are not necessary. ‘The'first consideration’ shoul 
‘be: making minor adjustments ina kids program.” For: ‘example, one panelist 


‘Stated: that some “school districts simply ask the teacher ‘upon referral of, a child: = 


‘to ist five specific approaches. he/she’ ‘took in trying to. ‘resolve the” problem ° 
: oncerning the: child. Another. school district described by: a: “panelist ‘requires: 
“teachers to sign’ their: name to ‘a statement on the referral form-to the effect that 
the child isnot benefiting sufficiently from regular: ‘classroom. _instrution. Both 
trategi were viewed pene! the Ruriber of ceteris! made by teachers. as 
¢From. the: perspective of the Bureau ‘of Eduication for the. Handicapped, ‘the ‘more 
Serious problem. ‘stems from under-referrals ‘and the possible tack of provision of - : 
special education’ and related services to those. children who. tequire them. Those ; 


* “panelists concerned with under- referrals felt. strategies were’ ‘needed’ to encourage 7 


eacher referrals. One panelist. ‘provided the following anecdote. ‘to illustrate. this’: 


int: “We conducted an experiment where we went into ‘three "schoo! districts ao 
id. tested all be Sar W and thit third graders. We. were worried. about. teachers: me 


a tiaras 


ome: ‘agreement: 
reeived as, ‘over: er 


A related concern was: ‘the adequacy of the. evaluations being conducted either t 
‘determine: a child’ "§ -elegibility. for. ‘special: “education services or tO: determine 
child’ s “special: education program, A Specific - area..of concern ‘was the 
time- consuming nature ‘of ‘thorough | ‘interdisciptinary . assessrnents. of children. 
The ‘parielists ‘agreed that ideally, teachers, school psychologists, “audiologists, 
vUrses,. and other professionals should ‘be involved in the diagnostic evaluations, 
in addition, assessments: should be multifactored with measures of adaptive 
- behavior, observation. ofs. the child. in natural settings, medical information, 
“sel f'reports, cand” the: like: The time: consuming Nature of. such: “procedures! 

= ‘however, coupled: ‘with, a high number | of ‘referrals, desire to process ‘the referrals 

i quickly, and not.enough ‘diagnosticians: for the number of referrals were’ viewed; 
as ahied: resulting i in less nen ideal implementation of assessment. procedures. 


“One possible strategy ‘suggested < resolving ‘these problems was to establish c case : 
ee jad “atios..for..thé_various: Categories: of diagnosticians: While-each. diagnostician 
as likely to have other responsibilities in addition to assessment, - a clear time. ; 
_ -block” “would be. defined for assessment activities. The number of cases. which 
- could. be handled in the time available could be determined, and projections of 
: “additional staft ‘needed. would. also be easily. detegpined. : 


ar ee 
“ - ge 8 


} program ‘interventions. One panelist expressed | ‘the’ question. 
“Do. we: haves different ways” “of. treating | ‘a. chile who: is: labeled pantely. 


categorical special educetion | programs are. always differentiated” in this respect 
re “discussion. of alternative approsche= “to labeling, sed to ‘other 


ee ee 


Ki yr example, one panelist suggested nai children ie described only: in terms of 
ithe: services they require based: on. the ‘individualized education’ program. A. 
onsequence. ‘found: with: this. approach, ‘however, has-been that a large. number of 
children, are’. identified. as ‘needing special. services. who were not eligible. for. 
pecial education and related services under’ the System of: categorical definitions. 


i of handicapping: ‘conditions. The: problem, as posed by. one ‘panelist. is that state. 


id:requirements for: the handicapped. are likely-to: doubie: While- other panelists - 
felt. that. all children: in. ‘need of: specific. services: should: be « provided "those: 
services, they: doubted: ‘that the- problems. of: Jabeling. would. be avoided. If, ‘as, 
stated. by a panelist, a_child is in: remedial. pees program 4, ithe child v will soon. 
be kriown ‘as a’ ‘program 4a" cehild.. ~ : 


: At east one - pandiist’ fait) that casnarch was deeded on educational interventions” 
‘or “treatments and the achievement of different. groups of. students. Specifically, 
“this panelist recommended a longitudinal study ‘of teacher-student™ in eractions - 


+ and. their effects-an low, average, and high achieving groups of students. Another | 


< panelist, however, felt. that aptitude-treatment interaction. research has shown: 
8 tittle promise to date. = * 


. The sane. did not sesalve Wie issue of labeling and come to ‘any recommenda: - 
* tion, For now, as stated ‘by one ‘panelist. “we are required by PL 94- 142 to 
-documert trte label ~— we are accountable RICCI, ’ 


—“Assessm ‘ “for ‘Educational 
- *Programming, Decisions 


Panelists stressed the need for clearer articulation of the linkages between - 


“assessment and: program intervention. Individual evaluations were. viewed as * 


“traditionally conducted .to determine a child's eligibility -for. special education: 
and related services or, in rriore. general terms, for classification purposes. While 


need-.was recognized for standard, assessments. which identify. cuter wo! vi 


equire. special educational. intervention, “panelists “emphasized: tes néed. for 
assessments: which also. ‘determine what specific interventions in the child! sss 
educational. prpgram should be made. : : : : 


{ decisions: ‘than’ for. programming: decisions, AS: stated By ‘one panel! ie 


ee such. as‘g’ will do-an excellent job of predicting who wilt and. will ae 


succeded ‘in school: Yt won ‘tdo.a: ‘very: good. job. of: ‘showing how: specifically a 


to. teach an individual child. ae SNorm-refere ced. tests were viewed. as. appropriate we 


‘assessment instruments: for aligiblity decisions, ‘and. criterion-referenced tests as 
appropriate “assessment - “instruments for. - Programming decisions. ‘The panel 
generally: ‘agreed’ ‘that: assessments “should” include the. multiple: t pes of dataand, 
following | the: PL 94-142° regulations, include. those tests: t lored to” assess. _ 
specific areas tor educational: . ‘need and not merely those. design i to produce a. 
single, rere intelligence Quotient. 


One panelist suggested that. linkegee? among assessment; program. intarvention: 

. and program review “activities would’ be“Strengthened if the evaluation: team : 
“consisted. of the same persons who develop the child’s individyalized, education 

“program: (IEP). The team’ was described as. including, ata. minimum, a teacher, a 

‘ special: “education. specialist. with ‘expertise. in individual. educational: program- 
ming, a a.school psychotogist, sand parent of. the child. Another panelist: ‘warned, 
“however, that more research, and test development, was ‘eeded before faith could © 
: be placed | in relationships between. test: Performance. and educational prograrn- : 
“ming. This panelist cited a ‘commonly used diagnostic instrument. ‘One could 
‘work with the chitd and raise the child’s ‘score on the test, but this does. not 
mean that the. child’ reads any better. While. there was “agreement ‘that more 
“research - -was needed in “this area, other. panelists Stated that with the use ‘of 
" criterion: referenced tests ‘and the “systematic application of the principles of 
~Jearning,-‘ ‘we gan move kids formed instructionally.”” 


; ‘ak ty oie | 


“There. was -agreerhent among panelists that the depetonmient of. procédures to. : : . . 


: evaluate implementation of the PEP procedures was a useful endeavor. There. 
.. were, however, - different views: concerning evaluation: methods ‘and content. 


rece _Several_panelists_recommended_the-development-of-a-checklist: -or-quide-which—~~ 


could be-used' by school districts on.a self-study basis. It was pointed. out by one > 


panelist, that. many school: districts. still essentially use the IQ test for decisions | = 


concerning eligibility and * programmirig and the guide or checklist would be s 
Re) Ip fut. asa means of improving practice. ‘Another panelist. was. of -the opinion’ 
= that a “guide. would. be too limited me use if itswas focused towards the. below . 
os average. or: average district:in terms: of PEP implenientation. Another suggestion. 
: oMored a full valuation Procedure. A district would take the names ofa arendem s 


© 


: niet collected would include sdafercal: forms, “the: ; 
assessment “and. Aisgnosis, the. TEP, _ and. Performance — “Among . ‘the 


a at ee 


All ‘thee: “of: he- panel -subaroups recommended the development ‘of either ° 


a planning and programming. “systern:: For each, stage. is ues, “critical ‘events, 
an sel Fevaluation: strategies, and. -possible. corrective actions would. be identified. 
Each state and schoot: ‘district, however, would have to adapt the guide to imeet. 

its own, needs. Group, it, which had. many recommendations similar’ to those. of: 
‘the first group, recommended. a ‘seif- study. ‘guide which.would, include sections on... 
Cc compliance, monitoring, and ‘evaluation of the PER provisions. Rationales,- -issues ,* 
standards, good:practice™ examples, and criteria would ‘be ‘identified “and © 
‘discussed. “Group . Ht focused on developing a ‘model stor fair: decision: -making- : 
“procedures.” concerning. the educational placement of children. The model, which 
utilizes, a ‘cascade system, closely. relates agsessment to Bregrarnng issues. 


. a. : i 


Panelists in 1» Group | took: the position that assessment activity. nould not be 
.* viewed asa separate component. in the. child planning and Brogramming. ‘process. 
‘They recommended that assessment: activities be. examined: in relation to each’. 
. stage’ in the child identification -artd planning process. Stages were identified aso 
Wh prescreening, (2) screening, (3) referral: (4) individual evaluation, and:(S) 1EP 
. development and implementation. ‘The last stage includes placement, panels 
-mrecommended-the development-of-a-technical-assistance- document whith: would=——-~ 
decal assessment activities. in each stage. 


i The « group provided a an A aierble ofa conceptual Framework for eich a. technical * 

7 -assistance: document, For ‘each of the above ‘stages in the child identification’ ‘and <> 

zl planning } process, procedural: issues, ‘critical events, self. evaluation strategies, and: .. 
oe - examples of: ‘possible corrective actions: would be described. These’ four topics, 73 
where appropriate, would: ‘be addressed poabarstelys for: the school district and= 


; At a case » level, an evaluation strategy: might mandorily. select a. number OF the: 
parpanent: record ‘files of transfer students to. determine if a review: of the child! ‘Ss 


. raterral: “stage, “to. provide another. example, peel “issues mightainclude 
discussion. of the bias” in. the referral. process. A critical eventin, this stage would, : 
be the: obtaining o parental consent for child evaluation. ear ae 


The panelists in’ this group ad that. ‘the technical akntings dbcurpent ‘would 
have. to; .be..modified by each state $0.a§, tO. ‘be: consistant with-state wWquiremen 
and ‘mortoring: procedures. : At was. suggested’ that. a “conceptual “framework, be- 
ailable which the ‘states: ‘could then: develop | into :a technical: ‘assistance 
3 document. “Even. df the technical ‘assistance. document was developed by” each » 
“state, “the grup. Felt. that itewas critical that the format allows school. disttict. 


on -pergorinel to ada their. ‘pwn. ‘identified procedural issues, critical events, Aicke 


" evaluation Strategies, and description of successful and unsuccessful corrective: 
‘actions. ts was s ated that untess. the school districts could. make it. their own - 
- sdocument.. othe technical assistance document woud be tittle used. 


Finally, the group did not t recominend formal field-testing, although: feedback to 


Me the ‘developers of the framework was “thought . to. ‘be: ‘potentially useful: State “ 


“education agency personnel and regional ‘resource: center. personnel were harried , 
as possible disseminators of technical assistance documents. ; : 


Sekt 


: ariatists fan Group-t \-recommnanded the. development of a seif- study ‘guide which Le 
would ‘address four pajor provisions: of the. Jaw—prdtection . in: evaluation ~ 


Pp cedures, jeast: ‘restrictive . environments, . due process, “and ‘individualized 
oe ucation programs. Although they were. concerned with the magnitude of such | . 


1a guide, these“panelists agreed that the components. should not be: viewed! as. 
ad: entities. In addressing thernselves to ‘the: PEP section -of the guide, 


he. group. also. ‘had specific’ suggestions « on. the content of the PEP section. ‘First, 
2 fecoramendation was made that thes PEP. section, not focus ‘on. an. “ayerdye” 


‘ ‘different | ‘levels of sopernbotation, Thus, the section v was. apceved as. sadarasiina. 
current, «compliance fequirements, ‘Strategies, for monitering implerrientation 1 for® 


ommend: tounal “field: ctesting prior to disseminstion, they" sogoied tear: a 
up-of iocal- school: ‘district personnel could bee siembled. ak at “Face uahdity. pos 


feedback. of! “users: such as chao! psyehoi Q ais: pact: “minority ° group” 
: biaiiels atives; and ger “administrators. Jerealiys, - the, ganatists. were a 
hat development - the guide would. require the expertise of © 


oe 
» 


Group’ tH developed. a model for implementi ne. noe sseriminatory procedures, : 
father’. than an evaluation guide... The ‘model “assessment and 
: Programming. activities, and ~utiizes, ‘a ‘cascade. system wen. placements ona. 


As banelists- 


1; ali children "would begin i int the I ida ast t restrictive @ environment. ree 


needed. “Alter ‘regular Tlasstoomn! with 0 “support services, 
ive -alternatives. on ‘the: continuum would-be: ‘consultant: 5@ 
part- time tutorial hetp. for~ “the: chitel, 

, full time: resource room; .Dlavement, diagnostic/pre. 


According. t® the group: dcauneawion ‘would de required Belgie a chile would _ 
be transferred fram’a less ta mare restrictive placement ai ternative, Documenta- —- 
: ss ton would | include. description of ‘the educational strategi es which had been ° a 
“tried, ‘aswell a5 indication of the ‘extent to which the stratagies had been. 
~ Successful. No labeling of the, child as a speciai aducation student would occur” 
“until or. unless ‘the child reached" the fifth leyel of placement, full-time resource : 
room. It is at this:point tar the Child wouid. be formativ assessed by a school © 
psycholgist.. Norm: referenced tests would be administered to document the fact ” 
~ that the child’ was handicapped. If this: Mfth tevel. of placement was not 
“successful, the child would be placed in a systematic instruction or diagnostics’ - 
presoriptive class. At this stage, assessment Activity is tied closely to program- 
ming. © The teacher would “Systematically try to attain different kinds of 
“objectives with the child, using differeng teaching strategies, differant types of 
: materials, and feedback. "The qoaivis pe Laine evaluation of the chitd i in order 


% 


sto détermine. how the enstd can best be een re 8 fc A 
M3king the eae system’ ‘operat ional was viewed by ‘he yroup as ving. several ee 
advantages over ‘W nore traditional: plagement and programming system. First. _ 


through-out the filrering nbocess, adaptiv so behavior informass ion ‘is peing 
coliectect. An individual ‘ehiid. history: is built which documents “Sugeesstul and 
“Unsuccessful education approaches in terms oF child oer formance. Seandly, + up 
to a point. ach itel can simply be viewed as an i irucuonal casualty. Services can 
be delivered such gs speach or without additia Ral iabeling of 
the chit. The system thus has the potential ee) ba tie ed with CoMmpensarony 
aducation, programs. Group HH! concluded that this sborgach, while note ¢ 


remedial as 


‘the special acucation Held, wold provide a base for if 
a iF id a 
sa Implemented by school diswicis, cs ’ 
* “le . . R 4 “ 4 = us 


SUMMARY AND'€ONCLUSIONS = 0 ose 
. Commoanalities among the subgroups can bs summarizes! as fotloas: oor 
; . : 


: es : 


disseminate its. 
that tne > 


x ‘ 
Tero of the thrag subgroups 


compiance procedure te iogat 


tation. p: analigt s thought the eritariayes route er 
in implementiog the PEP provisions, ; 
rit techorcalr 


2. In. general,. were quite concerned hatang 


assistance document. would merely join acimenistratars! shelves of other 
waused manuals “on test selection and> achmninis tratiggr, procaduras. Pointing 
out that such “dood. practice” guides 4s ihe Arnerican Psy yeholouical 
; Association's test standards have lang been available, panatis® felt that if 
yo techs 


nal assistance materials were to be used by schoul district personnel, - net ge 
' 


they would require a format. which encouraged user modification and 
“individualization: ‘of. the materials. ay a ce i 


290° 


et ty peer ay ns 


3. Bil groups emphasi zed the. importance of tying assessment activities Closely 
to’ information needed for Referral, eligibility, placernerit, and programming 
“decisions. The groups agreed that. considering: PEP or non: discriminatory 


» bias throughout the decision-making process.. ae oe oe 


* their. ‘emphasis con evaluation practites ar implement ation practices, two of 
the groups stressed the utility of idéntifying good: practice ‘strategies. that have 
“been used sugges ssfully by: school districts. : 


A major. ‘concern a the Bureau ot Eausien me the ‘Handlicapped is the 
oS identification - of ‘children pligible to receive special eciucation: and related 
— services, The pesitfon papers and . summaries. af. panel discussians in, this 


’ 


~ . school district favel, Routin? screening procedures: are encouraged by the Bureau, 
“as ‘one. mean $ of insuring t 


har children who may require special: aducatian 


od issemmination cf this monograpiy stimulates othe! e ‘rhoughts on achieving quality 


no the Protecticin in Evdtuat ati i Pro SOE Hsions of PLS 


se 


testing. asa discyste component ot a sequentially cruares: process would allow . 


4. Al groups: recommended that technical assistance documents ar, anodels: be. 
oat directed 2 towards a local school di strict audience. While the | groups ‘varied ir: 


monograph’ SUgUESst many strategies for improving both assessment ‘procedures 7 
and « “the” “ase Of assessment information at the. district and. child levels of. 
implementat ion--One~strategy- fore iraproving assessment procedures on which . 
most panelists agreed was the establishing: of routine screening procedures atthe 


“services aia e tarred: for an individual «evaluation, dt is our hope. that” 
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